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15 Field of the Invention 

The present invention relates to a display system for producing an image and more 
specifically to methods for applying digital information to generate color and grayscale. 



20 



Background of the Invention 



A continuing objective in the field of electronics is the miniaturization of 
electronic devices. Most electronic devices include an electronic display. As a result, 
25 the miniaturization of electronic displays is critical to the production of a wide variety 
of compact electronic devices. For example, as electronic devices such as personal 
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digital assistants, cell phones, digital still cameras, DVD players and internet appliances 
become ever smaller and more portable, the demands on the electronic displays for 
these products must meet difficult and seemingly contradictory requirements. On the 
one hand, the displays must provide increasing amounts of high quality visual 
5 information, sometimes approaching that of a desktop monitor. Yet these displays must 
still be very compact and lightweight, consume little power, and be produced at low 
cost. Until recently, displays were not able to meet all of these requirements. 

The purpose of an electronic display is to provide the eye with a visual image of 
10 certain information. This image may be provided by constructing an image plane 

composed of an array of picture elements (or pixels) which are independently controlled 
as to the color and intensity of the light emanating from each pixel. The electronic 
display is generally distinguished by the characteristic that an electronic signal is 
transmitted to each pixel to control the hght characteristics which determine the pattern 
1 5 of light from the pixel array which forms the image. 

Two examples of electronic displays are the cathode ray tube (CRT) and the 
active-matrix liquid crystal display (AMLCD). There are other elecfronic displays, but 
none are so well developed as the CRT and AMLCD which are used extensively in 

20 computer monitors, televisions, and electronic instrument panels. The CRT is an 

emissive display in which light is created through an electron beam exciting a phosphor 
which in turn emits light visible to the eye. Electric fields are used to scan the electron 
beam in a raster fashion over the array of pixels formed by the phosphors on the face 
plate of the electron tube. The intensity of the electron beam is varied in an analog 

25 (continuous) fashion as the beam is swept across the image plane, thus creating the 

pattern of light intensity which forms the visible image, hi a color CRT, three electron 
beams are simultaneously scanned to independently excite three different color 
phosphors respectively which are grouped into a triad at each pixel location. 
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In contrast to the emissive type displays such as the CRT, an AMLCD display 
utilizes a lamp to unifomily illuminate the image plane which is formed by a thin layer 
of liquid crystal material laminated between two transparent conductive surfaces which 
are comprised of a pattern of individual capacitors to create the pixel array. The 

5 intensity of the illumination light transmitted through each pixel is controlled by the 
voltage across the capacitor, which is in turn controlled by an active transistor circuit 
connected to each pixel. This matrix of transistors (the active matrix) distinguish the 
AMLCD from the passive matrix liquid crystal devices which are strictly an array of 
conductors controlled by transistors external to the image area usually in the periphery 

1 0 of the matrix. The ability of each transistor to control the characteristics of just one 
pixel allows for the higher performance found in AMLCD displays in contrast to the 
passive arrays. 

In AMLCD displays, the electronic signals which control the images are 
15 transmitted to the pixel from driver circuits along the edges of the rows and columns. 
Typically when a row of image data has been assembled in the form of an analog 
voltage signal at each column driver at the edge of the columns, an enabling signal to 
the corresponding row driver activates the transistor connected to each pixel in that row 
to pass the voltage onto the capacitor forming the pixel. This storage mechanism is 
20 similar to dynamic memory cells (DRAM) although the cells are typically addressed 
serially (rasterwise) rather than randomly as DRAM impUes. 

In most displays, the electronic activation of the image must be continuous or 
persistent through repetition. In the CRT and emissive displays in general, a constant or 
25 highly repetitive source of energy must be applied to the pixel to create photon 
emission. Phosphor decay times are typically a few milliseconds. Similarly, the 
capacitors in the AMLCD array lose their charge through leakage and accurate 
grayscale levels are lost. Furthermore, many liquid crystal materials exhibit ion 
migration and must be reversed in polarity with each refresh cycle. In general, displays 
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with limited persistence must be refreshed frequently to avoid noticeable brightness 
variation known as flicker. On the other hand, displays with substantial persistence 
cannot display moving images without ghost images. Refreshing the image of most 
displays requires repeated transmission of the image data to the display, either from the 
5 broadcast source or from a storage device. 

Not all elecfronic products which contain an electronic display have memory for 
storing the data which is to be displayed. For instance, a television must activate the 
CRT display in real time as the broadcast signal is received unless a VCR or similar 
10 storage medium is employed. In computers, data is transmitted and stored digitally. 
O Moreover, in portable electronics devices, size and power constraints require the use of 

fi semiconductor memory which stores data only in digital format. In digital electronic 

W products, it is typical that a display controller is incorporated to receive and store the bit 

3 mapped image to be displayed and then to transfer that data to the display in a series of 

S 15 image frames at a rate high enough to look smooth to the eye. The semiconductor 
" memory storing the image bits is called the frame buffer, and the rate at which the data 

n i is refreshed on the display is called the frame rate. 

; 

; : 

5 It is an advantage in many applications to display large amounts of information 

° 20 requiring more and more resolution in the display. High resolution displays may 
contain hundreds of thousands of pixels. As an example, the Super VGA (SVGA) 
display resolution consists of 480,000 pixels. With a simple monochrome image and no 
grayscale, the frame storage is only equal to the approximately one-half megabit frame 
size. However, were the image to be fiiU 24 bit depth color (i.e., 3 colors and 8 bits of 
25 grayscale per color), the frame storage would approach 12 megabits. At the frame rates 
which are common today for high performance displays, at least 60 frames per second 
and up to 85 frames per second, as many as one gigabits per second must be transferred 
from the frame buffer to the display. The state of semiconductor technology at present 
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limits clock speeds to a level well below such transfer rates and parallel interfaces of 16 
to 32 bit widths are typical in high performance displays. 

It is a characteristic of analog displays that when the image data is stored in 
5 semiconductors, the digital information is converted to analog in a digital-to-analog 
converter (DAC) at the interface of the display. The digital representation of a pixel at 
the high standard of 8 bits of grayscale allows the creation of 256 separate shades per 
color (16 miUion distinct colors). In high performance displays, multiple DAC channels 
are required to provide the bandwidth of data transfer required. 

10 

As was noted above, most displays must be frequently rewritten to maintain an 
image. In the case of both CRT and AMLCD displays, data is being rewritten to one 
part of the display area while the rest of the array continues to display the prior image 
frame. This property is particular to monochrome displays and to color images are 
15 created from a composite of spatially separated sub-pixels. There is a clear advantage to 
writing and displaying data at the same time allowing each function to make maximum 
utiUzation of time allowed for each frame. 

Once data corresponding to an image is transferred to a display via electronic 
20 signals, there is an advantage to the display device being able to maintain the image 
unless a portion of the image must be altered to provide motion to the image. The 
amount of data written to the display in each subsequent frame can be substantially 
reduced if the writing operation is organized to be random, such as to write data to any 
location in the array and only to those locations where the data is changing for reasons 
25 that the image is moving or for reasons the array is reused sequentially to create a 
composite image. To achieve this end however, pixel locations which are not being 
rewritten must be able to store data and continually display it. 
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There exists a class of displays; primarily micro electro-mechanical system 
(MEMS) electro-mechanical devices and certain polymeric dispersed cholesteric hquid 
crystals, which are inherently bistable due to nonlinearities of the electro-optic response 
curve hi these displays, image storage within the device itself can be indefinite 
although without color or grayscale. Further, such devices cannot inherently provide 
grayscale in response to analog signals. However, grayscale can be achieved through 
time division of the image frame into a multiplicity of on and off states which on 
average provide a shade proportional to the signal pattern. 

Similariy, in an active matrix display a multiplicity of transistors may be 
provided in correspondence to each pixel such that a static memory (SRAM) cell 
(typically four or six transistors) can be utihzed to activate each pixel. There are several 
advantages to static memory such as the on-state output voltage always being at the rail 
voltage, the low activation current, no voltage decay, and sufficient signal to noise to 
read from the memory cells any stored data. However, because a static memory cell is 
itself bistable, the pixel activation will provide no analog grayscale. 

In general, displays with no analog response fall into three categories. Those 
displays with an extremely fast response in relation to the time divisions of the on-off 
cycles (as is typical of MEMS devices) can achieve grayscale through pulse width 
modulation. This modulation can be a modulation of the liquid crystal response while 
the illuminating pulse is held constant or a modulation of the illumination duration 
while the hquid crystal is controlled to be either on or off during the period of 
illumination. Hiose displays with a relatively slow response time in relation to on-off 
cycles (as is typical of liquid crystal devices) can achieve grayscale through a root mean 
square (RMS) voltage level based on the average time-voltage product. For display 
systems not falling into either of these special cases, a variety of alternative schemes 
may be employed. The inventions described herein will present several methods to 
provide high quality color display operation in these circumstances, hi all cases 
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however, there is a disadvantage in comparison to analog grayscale methodologies, that 
being the loss of parallelism of the data transfer of the grayscale bits. Data transfer 
rates from frame buffers to a binary display device can be significantly higher than an 
analog display. 

5 

There are two methods commonly used to generate color using a single electro- 
optic device. In the first, each picture element (pixel) is divided into three or more sub- 
pixels and a color filter, typically red, green and blue, is placed in the light path from 
each sub-pixel. The eye merges these sub-pixels to create a color image. This method 
1 0 suffers from significant light loss in the color filters, requiring up to four times as much 
power to be supplied to the illumination system. The color filters also add significant 
additional cost to the display. The second method avoids the high power requirement 
and added cost of the sub-pixel/color fiUer method. Instead, a single pixel is used for 
red green and blue images in a sequential manner. 

15 

The pixel sizes are also small relative to the size of color filters used in TFT 
AMLCD displays to create color triads for each pixel. There is a significant advantage 
to creating color through the sequential use of the entire array to create an image 
specific to each of the three prime color components. Through the utilization of 

20 separate light emitting diodes (LEDs) of each prime color to illuminate the display, the 
diodes can be turned rapidly on and off to correspond to the particular color component 
being displayed by the array at that moment. This method of color creation is called 
field sequential color wherein each color field is sequentially illuminated by the 
appropriate diode. Because at least three different color field images need to be 

25 displayed at a rate faster than can be resolved by the eye, the field sequential color 
method at least triples the data transfer rate required as compared to a monochrome 
display. 
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A need exists for a display system which can overcome the various above- 
described limitations of prior art display systems and be able to produce a high 
resolution field sequential color image which is not limited by the fi-ame transfer rate 
limitations of existing display matrices. The display system should also be adaptable 
5 for use as a microdisplay. 

In AMLCD panels, red, green and blue levels are stored into the array as analog 
voltage levels. These levels control directly the voltage applied to liquid crystal 
between pixel and ITO layer to produce the various shades of color under constant 
10 illumination. The voltage level of each pixel is maintained by the active-matrix circuit 
until a new value is applied to the pixel. 

Red, green, and blue component sub-pixels are simultaneously applied to the 
Liquid Crystal (LC) as a group to form a single pixel. Variations in color response of 
1 5 the LC is accounted for in each pixel, rather than by different voltage levels of ITO. 

Binary control of LC avoids many comphcations of analog drive methods. 
Analog control is far more sensitive to variations in cell gap, temperature, and LC 
contaminates, requiring high levels of quality control during manufacture. . 

20 

However, binary methods have inherently been more-limited in terms of color 
depth due to optical response time of ordinary LC. What is needed is a system and 
method of driving the aforementioned displays that overcomes the disadvantages 
inherent in the prior art. These and other advantages are provided by the display 
25 systems of the present invention. 
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SlilVllVl ARY OF THE INVENTION 

A display matrix is provided for forming a composite image from a series of 
sub-images. In general, the display matrix includes a plurality of display elements, each 
5 display element including a pixel, and a display circuit electrically connected to the 
pixel. Each display circuit includes a plurality of memory cells, and a selector for 
outputting to the pixel data from one memory cell at a time. 

According to one aspect of the display matrix of the present invention, a 
1 0 plurality of memory cells in the display circuit are continuously electrically connected 
to the selector of the display circuit at the same time. As a result, there is no need to 
address a particular memory cell to a particular selector. This may be accomplished, for 
example, by the display circuit including separate conductive elements for each memory 
cell in the display matrix which electrically connects a memory cell to the selector in 
15 the display circuit. 

According to another aspect of the display matrix of the present invention, the 
display matrix is formed on a substrate having a plurality of regions where each region 
includes a memory circuit with a plurality of memory cells, and a selector electrically 
20 connected to the plurality of memory cells in the region. The substrate may be any 
material on which the display circuit may be attached or formed. In a preferred 
embodiment, the substrate is a semiconductor, such as silicon, on which the display 
circuits are formed by one or more of a variety of methods known in the art. 

25 According to this aspect, the memory cells are physically inter-dispersed among 

the selectors within the plurality of display elements, hi this regard, the memory 
associated with the display matrix is integrated into the display matrix as opposed to be 
external to the display matrix and the selectors. 
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According to the present invention, at least a portion of the display circuits of 
the display matrix include at least 2 memory cells per display circuit. In one 
embodiment, at least a portion of the display circuits of the display matrix include at 
least 3 memory cells per display circuit. The display matrix may optionally include 4- 
18 or more memory cells per display circuit, depending on a variety of factors which 
will be discussed herein. 

In a preferred embodiment, the display matrix has sufficient memory such that 
data can be transferred to the display matrix for one sub-image while a different sub- 
image is displayed. The display matrix may also have sufficient memory to display two 
or more different sub-images without having to write to the memory cells between 
displaying the different sub-images. The plurality of memory cells in each circuit can 
represent different bits of a digital grayscale value. It is possible to vary the digital 
grayscale value significance of a particular memory cell image to image and field to 
field. The plurality of memory cells in each circuit can represent bits of different color 
fields. 

In one embodiment, the display circuit can be operated in a field sequential color 
(FSC) mode without having to write to the memory cells between displaying different 
fields. This enables the display matrix to not need an external fi-ame buffer. The display 
matrix may optionally be configured to be operated in a field sequential color (FSC) 
mode without having to write to the memory cells between displaying different fields. 

Data preferably can be both written to and read from the memory cells. In one 
embodiment, data for forming a sub-image can be written randomly to the memory 
cells. In a particular variation, the memory cells are static random access memory 
(SRAM) cells. 
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In one embodiment, the display matrix is sized to form a microdisplay. 
According to this variation, the pixels in the plurality of display elements may form a 
source object having an area equal to or less than about 400 mm^ and preferably 
between about 20 mm^ and 100 mml The pixels of the display matrix preferably have 
5 an area less than about 0.01 mm^ and more preferably between 50 m and 500 m . 

The present invention also relates to a display system which includes a display 
matrix according to the present invention and peripheral control circuits for controlling 
read and write operations to the memory cells. The display system may also include an 
10 illumination source for illuminating the pixels. In one embodiment, the display includes 
O a light emitting mechanism provided at each pixel. The display system may also 

include a light modulating mechanism, such as a liquid crystal material, provided at 
UJ each pixel. 

S 1 5 The display system may optionally further include logic for reading, inverting 

and rewriting data stored in the memory cells to provide a refresh cycle, a processor for 
m reading, modifying, and rewriting data stored in the memory cells to compose a bit 

^ mapped image without the need of an external frame buffer, control circuits for reading, 

O modifying, and rewriting data stored in the memory cells to provide a cursor function. 

^ 20 The peripheral control circuits may also serve to read, move, and rewrite data stored in 
the memory cells to provide a scroll function. 

The display system may also include an illumination source capable of 
providing a plurality of different color illumination to the pixels, the particular color 
25 illumination provided to the pixels being coordinated by the peripheral control circuits 
with the read and write operations to the memory cells. Two, three or more different 
colors of illumination may be provided. The illumination source preferably provides at 
least three different colors of illumination. 
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The display matrices and display systems of the present invention may be used 
in a display component of a variety of electronic devices. Examples of such devices 
include, but are not limited to portable computers, personal communicators, personal 
digital assistants, modems, pagers, video and camera viewfinders, mobile phones, and . 
5 television monitors. In one particular embodiment, the display matrices and display 
systems of the present invention are used in combination with one or more 
magnification optics to form a virtual image display system. 

The present invention also relates to methods of using the display matrices and 
10 display systems of the present invention to produce composite images as described 

herein. 

In an embodiment of the present invention, a system and method are provided 
for driving a display. A voltage value is stored in an analog memory associated with 

15 each pixel of a display, where each of the pixels has a comparator associated with it. A 
reference voltage and the voltage values stored in the analog memory are appUed to the 
comparators of the pixels. The comparators are used to compare the voltage values 
with the reference voltage for determining which of the voltage values matches the 
reference voltage. The state of the pixels whose voltage values match the reference 

20 voltage is changed. Preferably, the pixel(s) is actuated, i.e., to optically on or optically 
off, for a predetermined duration based on the comparison. 

Again, the display can be an active matrix panel display as well as a non-active 
matrix display, OLED display, or other type of display. As an option, illumination may 
25 be applied after the actuation of the one or more pixels. The reference voltage can be 
changed as a function of time to cause each pixel to actuate and de-actuate at a desired 
time. Groups of the pixels can be actuated, hi such case, the groups of pixels are 
actuated in multiple phased cycles. Preferably, the groups are interspersed on the 
display to avoid flicker at low update rates. 
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Methods will also be described for augmenting the display system with 
additional integrated circuits and firmware that can provide color and grayscale displays 
of various color depth. 
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Brief Description of the Drawings 

Figure 1 illustrates a display matrix. 

Figure 2 illustrates a display circuit which may be used in the display matrix of 
the present invention. 

Figure 3 illustrates a prior art display circuit. 

Figure 4A illustrates a cross-sectional view of a liquid crystal device. 

Figure 4B illustrates a top-down view of a liquid crystal device. 

Figure 5 illustrates a backplane integrated circuit (backplane IC) which may be 
used in a display matrix of the present invention. 

Figure 6 illustrates a configuration of strobe lines connected to display 
circuits. 

Figure 7A illustrates a virtual image display system which includes a display 
matrix which projects an image onto a back surface of the first magnification optic 
which reflects (at least partially by total internal reflection) the image to a surface 
having a magnification function and a reflection function. 

Figure 7B illustrates a virtual image display system which includes an 
illumination source which reflects light off the microdisplay system to a beamsplitter 
which reflects an image formed by the microdisplay to a surface of the first 
magnification optic having a magnification fiinction and a reflection fiinction. 
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Figure 7C illustrates a virtual image display system which includes an 
illumination source which reflects Ught off the microdisplay system to a back surface of 
a first magnification optic which reflects the Hght to a beamsplitter which reflects the 
Hght to a surface of the first magnification optic having a magnification fiinction and a 
reflection function. , 

Figure 8A illustrates the data transfer and display sequence of a prior art display 
matrix which employs a single memory cell per pixel. 

Figures 8B and 8C illustrate data transfer and display sequences that may 
be used when a display matrix according to the present invention which employs two or 
more memory cells per pixel is operated in an FSC mode. 

Figure 9A illustrates a time line for displaying one bit plane for a larger portion 
of the time that a particular frame is displayed by displaying that bit plane longer than 
other bit planes. 

Figure 9B illustrates a time line for displaying one bit plane for a larger portion 
of the time that a particular frame is displayed by displaying that bit plane more 
frequently than other bit planes. 

Figure 10 illustrates a pair of display circuits and a pair of pixels, wherein the 
display circuits are partially within the footprints of each of the pixels, and the pixels 
partially within the footprints of each of the display circuits. 



are 



Figure 1 1 illustrates a matrix of display circuits and pixels, wherein 
multiple data circuits overlap the footprints of multiple pixels, and data lines are 
connected to multiple display circuits. 
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Figure 12 illustrates five display circuits, each of which is partially within the 
footprint of each of five pixels, wherein a single set of data lines is connected to all five 
data circuits. 

5 

Figure 13 illustrates a local decoder connected to four rows of data 
circuits. 

Figure 14 illustrates a system in which a processor interfaces directly to 
10 the backplane IC. 

Figure 15A illustrates an address map including scroll buffers. 
Figure 15B illustrates an address map which can scroll pixel by pixel. 

15 

Figure 1 6 illustrates a system in which an external fi-ame buffer is placed 
between the processor and the backplane IC. 

Figure 17 illustrates part of a color rich mode sequence. 

20 

Figure 1 8 illustrates a color mixing mode. 

Figure 19 shows a block diagram of a display system employed in the present 
invention. 

25 

Figure 20 illustrates single color bit dynamics. 

Figure 21 illustrates how the BBC method is used to produce a single RGB. (red, 
green, blue) color fi-ame. 
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Figure 22 is a flow diagram of a process for generating an image utilizing 
balanced binary color. 

5 Figure 23 illustrates the basic shape of a waveform according to the DCW 

method. 

Figure 24 is a flowchart of a process for generating an image utihzing a digitally 
controlled waveform. 

10 

Figure 25A is a diagram of a circuit associated with a pixel according to an 
embodiment of the present invention. 

Figure 25B is a flow diagram of a process for driving a display utilizing an 
15 analog controlled waveform. 

Figure 26 illustrates spatially distributed phases for 1 bit of temporal color. 

Figure 27 illustrates spatially distributed phases for 2 bits of temporal color. 

20 
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DFSCRIPTION OF THE PRFFERRED EM BODIMENTS 

The present invention relates to a display matrix for forming sequentially 
5 formed composite images. As used herein, a sequentially formed composite image is an 
image formed by displaying a series of two or more different sub-images to an observer 
where the different sub-images are displayed one sub-image at a time on the display 
matrix. These display matrices can be used in a display system component of a variety 
of electronic devices. Examples of such devices include, but are not limited to portable 
10 computers, personal communicators, personal digital assistants, modems, pagers, video 
and camera viewfmders, mobile phones, and television monitors. In one particular 
embodiment, the display matrices and display systems of the present invention are used 
in combination with one or more magnification optics to form a virtual image display 



m 15 



system. 



A unique property of the display matrix of the present invention is that data for a 
plurality of sub-images may be stored in the display matrix simultaneously. This 
property eases the instantaneous bandwidth requirements of the display matrix and, in 
certain situations, actually decreases the amount of data which must be transferred to 
20 the display matrix from external memory locations. 

In general, a display system forms a sequentially formed composite image by 
displaying a series of sub-images to an observer at a rate preferably faster than the eye 
of the observer can resolve. Image quality is reduced if the eye is able to perceive an 
25 individual field sub-image, a phenomena known as flicker. In practice, it has been 
found that frame rates in excess of 60 Hz are necessary to avoid flicker. 

Ideally, the data for any sub-image should be present in the display matrix from 
the beginning until the end of the display of the sub-image. If the display matrix houses 
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only a single sub-image at a time, then ideally the entire data transfer should take place 
between the display of one sub-image and the next. This places high instantaneous 
bandwidth requirements on the system in order to transfer all of the data for a sub- 
image in the interval between the display of sub-images. 

Figure 1 illustrates a typical display matrix 12 which includes a plurality of 
display elements 14. Each display element 14 includes a pixel 16 and a display circuit 
18 which is electrically connected to the pixel and controls the operation of the pixel 16. 
The plurality of pixels incorporated into the plurality of display elements together form 
the source object formed by the display matrix 12. 

In a display matrix according to the present invention, the display circuit 
consists of a plurality of memory cells and a selector. The selector is able to output to 
the pixel the contents of at most one memory cell at any instant. The selector is 
controlled by additional input signals provided to the display circuit. 

Figure 2 illustrates a display circuit 18 which may be used in the display matrix 
of the present invention. As illustrated, the display circuit 18 includes a plurality of 
memory cells 20A, 20B (two shown) which are each electrically connected to a selector 
22. The selector controls which memory cell is electrically connected to the pixel 16. 
As illustrated, the display circuit 18 can also optionally receive one or more inputs 24 
for controlling the operation of the selector 22. 

As illustrated in Figure 2, a feature of the display circuit and display matrix of 
the present invention is that a plurality of the memory cells in the display circuit are 
continuously electrically connected to the selector of the display circuit at the same 
time. As a result, there is no need to address a particular memory cell to a particular 
selector. This maybe accompUshed, as illustrated in Figure 2, by the display circuit 
including separate conductive elements 21 for each memory cell in the display matrix 
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which electrically connects a memory cell to the selector in the display circuit. The 
figure illustrates that all the memory cells in the display circuit are connected. It is 
noted that less than all of the memory cells may optionally be continuously electrically 
connected. 

A further feature of the display circuit and display matrix of the present 
invention is that the display matrix is formed on a substrate having a plurality of regions 
where each region includes a memory circuit with a plurality of memory cells, and a 
selector electrically connected to each memory cell in the region. For example, Figure 
1 illustrates a plurality of display circuits in separate regions. By having a plurality of 
regions which each include a complete memory circuit, a display matrix is provided 
where the memory cells are physically inter-dispersed among the selectors within the 
display matrix. This distinguishes the display matrix of the present invention over prior 
art displays with an external frame buffer. The substrate may be any material on which 
the display circuit may be attached or formed. In a preferred embodiment, the substrate 
is a semiconductor, such as silicon, on which the display circuits are formed by one or 
more of a variety of methods known in the art. 

Yet a further feature of the display matrix of the present is its ability to store 
more than one image at a time. Because the display circuit 18 has more than one 
memory cell per pixel, it is possible to display two or more different sub-images 
without having to write to the memory cells between displaying the different sub- 
images. In addition, data may be transferred to the display matrix for one sub-image 
while a different sub-image is displayed. Accordingly, the data transfer time for one 
sub-image can be spread over the entire display time of a different sub-image. This 
alleviates the need for a high instantaneous bandwidth or a high sub-image display rate, 
a clear advantage over prior art display systems. 
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Figure 3 illustrates a prior art display circuit. As illustrated in Figure 3, the prior 
art display circuit includes a single memory cell 20C which is connected to pixel 16. 
The prior art display circuit thus does not need a selector or input for controlling the 
operation of the selector. Further, because the display circuit only includes one memory 
cell 20C, a memory matrix employing this display circuit can only store data for one 
sub-image and thus cannot display different sub-images without having to write to the 
memory cells between displaying the different sub-images. When it is necessary to 
create an image out of a composite of sub-images, the sub-images are typically 
composed in a spatial relationship and written simultaneously to the matrix. 

The display matrix of the present invention may be any addressable display 
which includes a pixel and a display circuit which controls the operation of the pixel in 
response to control signals. As used herein, a pixel (a contraction of picture element) 
refers to any mechanism which can either emit light or modulate incident light in 
response to an electrical field to form one element of a source object. The plurality of 
pixels incorporated into the pluraHty of display elements together form the source object 
formed by the display matrix. 

Examples of suitable pixels include but are not limited to the pixels used in 
liquid crystal displays, spatial light modulators, gratings, mirror light valves, and LED 
arrays. The pixels can be opaque or light transmissive. Opaque pixels can be fiirther 
divided into reflective, emissive, and scattering pixels. 

In one embodiment of the present invention, the pixels used in the display 
matrix are sized to be a microdisplay. As used herein, a microdisplay refers to a display 
matrix which is used in a virtual image display system to form a source object which is 
then magnified by one or more magnification optics to form a magnified virtual image, 
hi a preferred embodiment, the microdisplay forms a source object having an area equal 
to or less than about 400 mml In one embodiment, the source object has an area 
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between about 10 mm^ and 400 mm^ more preferably between about 20 mm^ and 100 
mm^ The pixels of the display matrix preferably have an area less than about O.Olmm^ 
and more preferably between 50 m^ and 500 m^ 

By designing a microdisplay to include a display circuit according to the present 
invention, microdisplays with reduced instantaneous bandwidth requirements and 
reduced average bandwidth are provided. The reduced bandwidth requirements translate 
into lower power consumption, which is particularly important for battery-powered 
applications in devices which incorporate microdisplays. 

In one particular embodiment, a microdisplay is provided which includes a 
liquid crystal device (LCD) and operates in either reflective or scattering modes. 

Figure 4A illustrates a cross-sectional view of a liquid crystal device while 
1 5 Figure 4B illustrates a top-down view of a Uquid crystal device. As illustrated in 
Figures 4A and 43, the LCD 32 is composed of a substrate 34 having a plurality of 
electrodes 36 corresponding to pixels, liquid crystal 38 arranged on the substrate 34, 
and a counter electrode 40 arranged on the liquid crystal 38. The liquid crystal is 
caused to align or relax at each pixel in response to local electric fields applied across 
20 the liquid crystal between the pixel and the counter electrode. The potential at each 
pixel on the substrate is determined by the corresponding display circuit, the design of 
which is the subject of the present invention. Sequentially changing the potentials at 
any or all of the pixels on the substrate via the corresponding display circuits causes the 
LCD as a whole to form a composite image when properly illuminated. 



25 



According to this embodiment, a sub-image is observed when the LCD is 
illuminated after allowing sufficient time for the liquid crystal to align or relax 
according to the voltage pattern on the pixels. A multicolor image may be produced by- 
performing the following sequence sequentially with different colored illumination 
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sources: (1) turning off illumination; (2) stimulating the liquid crystal with a voltage 
pattern on the pixels for a first sub-image or field; (3) waiting a sufficient period of time 
for the liquid crystal to form the source object; and (4) illuminating the liquid crystal. 
The above sequence is repeated for each light source present. 

5 

Figure 5 illustrates a backplane integrated circuit (backplane IC) which may be 
used in a display matrix such as a LCD microdisplay. As illustrated, the backplane IC 
42 integrates into a single electronic circuit a display matrix 44, programmable registers 
46 that generate the control signal logic 48 provided to the display matrix 44 and other 
10 timing functions, and an interface 50 to a source of image data. A display matrix for 
this backplane IC may be sized to include an 800 by 600 two-dimensional array of 
display circuits. 

The display circuit for a backplane IC according to the present invention is 
1 5 composed of two or more memory cells and a selector circuit. The memory cells may 
be conventional Static Random Access Memory (SRAM) cells composed of six 
transistors each, though the use of other digital memory cells is intended to fall within 
the scope of the present invention. 

20 Using SRAM for the memory cells facilitates fabrication of the IC. SRAM can 

be fabricated by the same process steps and fabrication tools as the selector circuit. For 
example, the selector and SRAM may be formed on a substrate with one poly-silicon 
layer and three or four metal layers, lp3m or lp4m. This obviates the need for 
different fabrication processes for the memory and logic components of the IC, and 

25 reduces the number of mask levels required in fabrication. 

As an example of a display circuit, in a three color system, the SRAM cells may 
be called RED CELL, GREEN CELL, and BLUE CELL, respectively. The cells are 
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addressed for reading and writing via WORD signals. Data is transferred into and out 
of the SRAM cells via BIT and BIT BAR signals. 

There are two basic configurations of the three SRAM cells. The cells can share 
the BIT and BIT BAR data signals and have separate address signals, possibly named 
RED WORD, GREEN WORD, and BLUE WORD, respectively. Or the cells can share 
a WORD address line and have separate data signals, such as RED BIT and RED BIT 
BAR, etc. 

The selector is accomplished with switches that connect the SRAM cells to the 
pixel at the output of the display circuit. The switches may be pass gates controlled by 
RED STROBE, GREEN STROBE, and BLUE STROBE signals, respectively. When 
the RED STROBE signal is asserted, the voltage stored in the RED CELL is transferred 
to the pixel. The GREEN STROBE and BLUE STROBE signals operate analogously. 
The various WORD and STROBE signals are provided to each display circuit based on 
programmable registers inside the backplane IC but outside the display matrix. 



When the RED STROBE is asserted over the entire display matrix, a voltage 
pattern corresponding to the data stored in the RED CELL of every display circuit is 
20 output on the pixels. The GREEN STROBE and BLUE STROBE signals operate 
analogously. 

In an embodiment of the present invention, each cell is connected to a individual 
strobe line. This design allows each cell to be strobed individually, thereby minimizing 
25 the power consumed in the operation of the display system and optimizing the operation 
speed of the display. 

In an alternative embodiment, multiple cells are connected to individual strobe 
lines. This design reduces the wiring density of the IC. By varying the number of strobe 
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lines used, the display system can be designed to have a desired level of wiring density. 
It is noted that power efficiency and operation speed decrease as wiring density 
decreases. The particular wiring density that is preferred will depend upon the 
particular application for which the display is being designed and the wiring density, 
5 power efficiency, and operation speed that are required. 

Figure 6 illustrates an embodiment where the total number of strobe lines in the 
display system is reduced from a 1 : 1 strobe Une to memory cell ratio by increasing the 
number of memory cells connected to individual strobe lines, hi particular, Figure 6 

10 illustrates an embodiment where each strobe line corresponding to a color and is 
connected to a plurality of cells of the respective color so that each STROBE signal 
controls a plurality of cells of the respective color. The figure depicts four display 
circuits 600, 602, 604, 606 with three SRAM cells per display circuit. Each display 
circuit 600 has a RED CELL 608, a GREEN CELL 610, and a BLUE CELL 612. The 

1 5 four RED CELLS (608A-D) are connected to a single RED STROBE 614 by 

connection 614A the four GREEN CELLS (610A-D) are connected to one GREEN 
STROBE 616 by connection 616A, and the four BLUE CELLS (612A-D) are 
connected to one BLUE STROBE 618 by connection 618A. When the RED STROBE 
signal is activated, the voltages stored in the four RED CELLS comiected to the RED 

20 STROBE are transferred to their respective pixels. The GREEN STROBE and BLUE 
STROBE signals operate analogously. 

As can be seen from Figure 6, it is possible to reduce the number of strobe lines 
in a display system from a 1:1 strobe line to memory cell ratio by having multiple 
25 memory cells be controlled by a single sfrobe line. It should be understood that 

depending on the application, it may be desirable to increase the number of strobe lines 
in order to minimize power consumption at the expense of display thickness or decrease 
the number of strobe lines in order to reduce the thickness of the display at the expense 
of power consumption. 
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The display matrix of the present invention can be designed to be employed in a 
wide variety of electronic devices in which a real or virtual image needs to be displayed. 
In particular, the display matrix is intended for use in small sized electronic devices 
5 such as portable computers, personal communicators, personal digital assistants, 

modems, pagers, video and camera viewfmders, mobile phones, television monitors and 
other hand held devices. 

In one particular embodiment, the display matrix is employed in a virtual image 
10 display system where the display matrix forms a source object which is then magnified 
by one or more magnification optics. In this embodiment, the display matrix is 
preferably sized to be a microdisplay. 

Figures 7A-7C illustrate three examples of a virtual image display which include 
1 5 a display matrix according to the present invention, and one or more magnification 
optics. 

Figure 7A illustrates a virtual image display system which includes a display 
matrix 62 which projects an image onto a back surface 63 of the first magnification 
20 optic 64 which reflects (at least partially by total internal reflection) the image to a 
surface 65 having a magnification fimction and a reflection function. The surface 65 
reflects the image to a second magnification optic 66 and to an observer 67. 

Figure 7B illustrates a virtual image display system which includes an 
25 illumination source 69 reflects hght off the microdisplay system 62 to a beamsplitter 71 
which reflects an image formed by the microdisplay to a surface 73 of the first 
magnification optic 64 having a magnification fimction and a reflection fiinction. The 
surface 73 reflects the image through the beamsplitter 71 to a second magnification 
optic 66 and to an observer 67. 



INV1P003 



-27- 



Figure 7C illustrates a virtual image display system which includes an 
illumination source 75 which reflects light off the microdisplay system 62 to a back 
surface 77 of a first magnification optic 64 which reflects the light to a beamsplitter 79 

5 which reflects the light to a surface 8 1 of the first magnification optic 64 having a 
magnification function and a reflection function. The surface 81 reflects the light 
through the beamsplitter 79 to a second magnification optic 66 and to an observer 67. 
Examples of virtual image display systems which can be used include but are not 
limited to the virtual image display systems described in U.S. Patent Nos.: 5,625,372; 

1 0 5,644,323 ; and 5,684,497 which are each incorporated herein in their entirety by 
reference. 

One feature of the present invention is the efficiency with which the display 
matrices of the present invention may be operated in a field sequential color (FSC) 
1 5 mode. In a typical FSC mode, a composite image is formed through the repetition of a 
sequence of different color sub-images, typically red, green, and blue sub-images. As 
illustrated in Figures 8A and 8B, the one or more sub-images 26 corresponding to a 
color is called a field 28. A single sequence of the different fields is called a firame 29. 

20 Sub-image data generally differs by field 28 in an FSC system, hi the special 

case where the data is identical across the red, green, and blue fields, the composite 
image appears monochrome with gray levels. 

Data transfer requirements for an FSC mode are more stringent than for a 
25 general system for sequentially formed composite images. The total length of time that 
a sub-image may be displayed, fi-om the end of the display of the prior sub-image to the 
end of the display of the current sub-image, is limited by the minimum frame rate 
necessary to avoid flicker. The data for a particular sub-image must also be present in 
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the display matrix from the begimiing to the end of the sub-image. The quality of the 
image produced is reduced if part of the one color frame is displayed while a part of 
another color frame is displayed. 

5 Figure 8 A illustrates the data transfer and display sequence of a prior art display 

matrix which employs a single memory cell per pixel. As illustrated, the entire data 
transfer for a sub-image takes place during a time period Tdt after the time period for 
displaying the prior sub-image Tdi-i and before the time period for displaying the 
current sub-image, also Tdi-z- In order to avoid flicker, the period of time available for 
10 data transfer and display is limited by the minimum frame rate Tmfr. The need to 

y transfer the entire data for a sub-image during the time period Tdt which is less than the 

minimum frame rate Tmfr time period creates a high instantaneous bandwidth 

\l requirement on a prior art display matrix operating in an FSC mode. The average 

J bandwidth requirement, which is a direct fiinction of the frame rate as well, is 

£0 15 accordingly high. 



Figures 8B and 8C illustrate data transfer and display sequences that may be 
used when a display matrix according to the present invention which employs two or 
more memory cells per pixel is operated in an FSC mode. When a display matrix 



20 employs two or more memory cells per pixel, it is possible to store data for more than 
one sub-image, whether of the same or a different field. In one embodiment, the display 
matrix includes sufficient data to store all of the individual sub-images of a field or the 
entire composite image simultaneously. 



25 



As illustrated in Figure 8B, by having sufficient memory to store multiple sub- 
images, it is possible to display multiple sub-images of a field, optionally all the sub- 
images of a field, without having to transfer any data into memory. Alternatively, as 



illustrated in Figure 8C, by having sufficient memory to store multiple sub-images, it is 
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possible to display one sub-image while transferring data for another sub-image into 
memory. As discussed herein, the ability to display one sub-image while transferring 
data for another sub-image into memory enables one to produce more colors and other 
visual effects than would otherwise be possible due to the greater instantaneous 
bandwidth requirement of prior art display matrices operated in an FSC mode. 

As demonstrated by the data transfer and display sequences illustrated in Figures 
8B and 8C, the use of two or more memory cells per pixel in a display matrix 
significantly reduces the instantaneous bandwidth requirement of the system. In 
addition, in the case where the data for one particular field sub-image is the same as the 
that for the next sub-image of the same field, the data for the next sub-image does not 
need to be transferred at all, reducing the average bandwidth requirement. 



The present invention is intended to encompass display matrices where each 
1 5 memory cell consists of one bit or more than one bit of memory. As used herein, a 

digital display system refers to a display system where a single binary bit of memory is 
associated with each memory cell. In this system, the selector outputs a binary value as 
a function of the data stored in the memory cells, and binary control signals are 
provided to each display circuit. By binary is meant a two-level voltage system, where 
20 each voltage can be represented by either a 0 or a 1 . 

In a digital display system, gray levels within a particular color field may be 
attained by multiplexing different sub-images of that field. By showing certain sub- 
images of a field longer than other sub-images, certain sub-images are rendered more 
25 significant to the composite field image than other sub-images. For instance, in a 

display matrix with two memory cells per display circuit, the first memory cell in each 
display circuit may correspond to the most significant bit (MSB) of the binary 
representation of the grayscale values for a particular field. The second memory cell in 
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each display circuit may correspond to the least significant bit (LSB). In a display 
matrix with three memory cells per display circuit, the first memory cell may be the 
most significant bit (MSB), the second memory cell the second significant bit (SSB), 
and the third memory cell the least significant bit (LSB). 

By displaying each bit for different portions of the time that a particular fi-ame is 
displayed, a multiple grayscale field may be formed. One bit may be displayed for a 
larger portion of the time that a particular firame is displayed either by displaying that 
bit longer, as illustrated in Figure 9A, or by displaying that bit more fi-equently, as 
illustrated in Figure 9B. For example, a four-level grayscale system is achieved in a 
two bit system when the MSB sub-image is displayed for twice as long as the LSB sub- 
image. The total display time for both sub-images equals the display time for the field. 

Generalizing the concept of temporally multiplexing binary sub-images, the 
number of gray levels possible is equal to 2^, when N is the number of sub-images. 
One particular sub-image corresponds to the MSB of the binary representation of the 
gray level; another to the LSB. Sub-images corresponding to the (l"** SB), 3"* (3' 
SB), and further significant bits of the binary representation are possible for systems of 
more than two sub-images. The total duration of one sub-image is proportional to 1 / 
2^, where M is the significance of the bit corresponding to the sub-image. The total 
duration for one sub-image may be continuous or broken into smaller time slices for 
interleaving with other sub-images. 

The total number of perceived colors possible in a system is the product of the 
number of gray levels for each constituent color field. For example, 64 colors may be 
generated by a three color system where each color has a four degree gray level 
(4x4x4). 
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In one embodiment of the present invention, two memory cells are present in 
each display circuit. Once data has been loaded into the display matrix, it is possible to 
fonn either a dichromic composite static image or a four-level grayscale monochromic 
composite static image. In the dichromic case, one memory cell of each display circuit 
contains the data corresponding to one color field and to the location of the display 
circuit within the image. The second memory cell contains the corresponding data for 
the second field. By cycling between the two sub-images corresponding to the memory 
cells within each display element, a dichromic composite static image is formed. 

In the four-level grayscale case, the memory cells of each display circuit contain 
the MSB and LSB of the image data associated with a single color field. By cycling 
between the two corresponding sub-images, while keeping the total duration of the 
MSB image twice that of the LSB image, four levels of grayscale are achievable. 

It is noted that in both the dichromic and four-level grayscale cases, if the image 
is static, there is no need to load data into memory more than once. A display system of 
the present invention just continues cycling between the two sub-images to achieve the 
intended effect. Data is only reloaded when the image content changes. In contrast, in 
a prior art display system with only a single binary memory element in each display 
circuit, data would have to be loaded in with every sub-image, for both the dichromic 
and four-level grayscale cases, regardless of whether the image content had changed. 
Even if the sole memory element were analog, data would still have to be loaded in with 
every sub-image for the dichromic case. 

In analogy with the two cell case, with three memory cells present in the display 
circuit, a three-color composite image and an eight-level grayscale monochromic 
composite image are possible with data reloading not necessary until the image content 
changes. With four memory cells, three basic cases are possible: (1) a four-color - 
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composite image; (2) a dichromic composite image with four levels of grayscale in each 
color; and (3) a 16-level grayscale monochromic composite image. 

In analyzing display circuits with more than four memory cells, many 
5 permutations of numbers of color fields and grayscale levels are possible and are all 
intended to fall within the scope of the present invention. If the analysis is confined to 
typical display systems operating in an FSC mode with three fields, some of the 
interesting display circuits are those with (1) six memory cells for four levels of 
grayscale per field; (2) nine memory cells for eight levels of grayscale per field; (3) 
1 0 twelve memory cells for 1 6 levels of grayscale per field; and (4) eighteen memory cells 
for 64 levels of grayscale per field. 

In general, each memory cell in a display circuit of the present invention 
corresponds to a sub-image. The sub-images corresponding to different memory cells 
15 are output fi-om the display matrix according to the control signals provided to each 
display circuit. The sub-images can have any order and may be displayed for any 
amount of time. For example, a particular sub-image may be displayed more frequently 
than other sub-images, as in the case of the MSB sub-image. The sub-image may also 
be displayed for a longer period of time than other sub-images. 

20 

The assignment of sub-images to different memory cells may be dynamic. In a 
system with three bits of memory for display element, the assignment of the first, 
second, and third memory cells as the MSB, SSB, or LSB can be changed, field to field 
and/or frame to frame. For example, the first memory cell of every display element 
25 may at one time be assigned to the MSB sub-image of the red field and at another time 
to the LSB sub-image of the green field. 

In display systems for sequentially formed composite images, the display image 
data is transferred to the display matrix from a frame buffer. The frame buffer is 
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typically external to the display system in the sense that the frame buffer is a separate 
component from the display matrix. 

The purpose of an external frame buffer is to house an entire frame of data and 
act as an intermediary between some sort of processor, which initializes and modifies 
the image in the frame buffer, and the display matrix, which displays the image or part 
thereof The data transfer bandwidth between the processor and the frame buffer varies 
according to the rate of change in the content of the image. For example, a static, 
monochromic image requires essentially zero bandwidth. In a display system operating 
in an FSC mode with a high frame rate, the bandwidth requirement remains high 
regardless of how static the image may be. 

A display matrix of the present invention can also be used to store multiple sub- 
images, for example all the sub-images of a single color field as opposed to an entire 
frame. For example, with three memory cells in each display element, the memory cells 
can be assigned to the MSB, SSB, and LSB sub-images of a color field, for a total 
number of 2^ = 8 shades of gray. If the memory cells are then reassigned to 
corresponding sub-images of the next color field during the display of the next color 
field, then 8 levels of grayscale will be possible for the next color field as well. For an 
entire frame, a total of 8^ = 512 colors are possible. 

Using a display matrix of the present invention operated in an FSC mode, it is 
possible to house an entire frame of data in the display matrix itself For example, a 
three color FSC system may be built from a display matrix having three memory cells 
in each display element. Each memory cell would be dedicated to a different color field 
sub-image. Since there would only be one bit per field, the total number of colors 
possible in the system would be l' = 8. With six memory cells in each display element, 
4^ = 64 colors would be possible. 
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The advantage of housing an entire frame of data within the display matrix is 
that the external frame buffer may be completely eliminated from the display system, 
saving not only a component but also a great deal of bandwidth. Only the bandwidth 
between the processor and the display matrix would remain. In contrast, operating a 
prior art display matrix in FSC mode, there is no room within the display matrix to 
house multiple sub-images simultaneously, necessitating an external frame buffer. 

One condition for eliminating the external frame buffer is that the display matrix 
behave like an external frame buffer from the processor point of view. In particular, the 
display matrix should behave like a memory: random access addressable as well as 
readable and writable. In contrast, the display matrix of prior art typically is not 
random access addressable and is only writable. 

The primary interface to the display matrix from the source of image data can 
mimic that of a synchronous SRAM. For example, the clocked interface includes a 
general backplane IC chip select and a read / write signal. An internal write buffer 
supports consecutive writes to the memory cells in the display matrix and to 
programmable registers outside the display matrix. The latency to the first read data 
from either the memory cells or the programmable registers is a fixed number of cycles. 
Data on consecutive cycles is returned on burst reads. The length of burst accesses can 
be programmed to be 1 , 2, 4, or 8 words, where the length of a word is defined as the 
data bus width. The latter is initialized to 8 bits on reset, but can be reprogrammed to 8, 
16, or 32 bits. A total of 20 address Unes can be used to specify the destination of a 
read or write to the memory matrix. 

A secondary interface optimized for minimum pin count is also possible. The 
secondary interface can include a vertical synchronization signal, a horizontal 
synchronization signal, a data enable signal, and a clock, along with 8, 16, 24, 32, or 
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some other intermediate number of bits of data. The secondary interface can be used to 
scan data into the display matrix only, with no capability to read data from the matrix. 

A variety of actual sources of image data outside the display matrix may be 
used. For instance, read only memory (ROM), programmable memory such as a field 
programmable gate array (FPGA), an external frame buffer, or a processor are possible. 

Layout Designs for Display Circuits 

An aspect of the present invention relates to layout designs for positioning a 
plurality of display circuits adjacent pixels of a corresponding display element. For 
instance, in a display system of the present invention, there are multiple memory 
elements per pixel. As the number of memory elements per pixel increases, it becomes 
increasingly difficult to position the display circuit including the plurality of memory 
elements adjacent the pixel. It is thus necessary to design the layout of the display 
matrix to accommodate for display circuits which do not fit within the spatial confine, 
or "footprint", of the corresponding pixel. 

One aspect of the present invention relates to a display matrix layout design 
where the display circuit is at least partially positioned outside of the footprint of the 
pixel. Another aspect of the present invention relates to a display matrix layout design 
where a display circuit is positioned within the footprint of two or more pixels. Yet 
another aspect of the present invention relates to a display matrix layout design where 
two or more display circuits are positioned within the footprint of a pixel. These layout 
designs allow multiple memory cells to be positioned more closely adjacent each pixel. 

The layout designs described above are illustrated in Figures 10-12. Figure 10 
illustrates two rectangular display circuits 202A, 202B placed under two pixels 204A, 
204B. Each display circuit is at least partially located within the footprints of both 
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pixels. Additionally, each pixel is placed within the footprints of both display circuits. 
However, each of the display circuits has an electrical connection to only one of the 
pixels 206 A, 206B, thereby preserving the correspondence of one pixel to one display 
circuit in each display element. 

One feature of the layout designs illustrated in Figures 10-12 is the positioning 
of multiple address lines under each pixel or under each row of pixels, hi order to 
facilitate random access to the memory elements of each display circuit, each of the 
display circuits must be separately addressable. This requires each display circuit to be 
connected to an address line. When two or more display circuits are placed in the 
footprint of a pixel, the same number of address lines are placed under the pixel, one for 
each display circuit. 

The positioning of multiple address lines under each pixel and under a row of 
pixels is illustrated in Figure 10. Each of the display circuits 202 A and 202B is 
connected to a single address line, 208A and 208B, respectively. But since both display 
circuits lie within the footprint of one pixel 204A, there are two address lines running 
under one row of pixels 212 in the display matrix. 

The layout illustrated in Figures 10-12 were multiple display circuits are 
positioned within the footprint of a pixel provides a further advantage of enabling a 
substantial decrease in the number of data lines (e.g., bit and bit bar lines) used in the 
display system. By placing multiple display circuits within the footprint of an individual 
pixel, multiple data circuits can be connected to a single pair of bit and bit bar lines. The 
layout also results in an increase in the number of address lines that are used in the 
display system in order to preserve random access to the memory elements in the 
display system. However, the reduction in the number of data lines is more significant. 
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Each display circuit in the display matrix connects to a BIT line and a BIT BAR 
line. By placing multiple display circuits within the footprint of each pixel, each 
display circuit within the footprint of a pixel can be connected to the same BIT and BIT 
BAR lines. This allows for a net reduction in the number of BIT and BIT BAR lines 
5 connected entering the display system. 

How the number of data lines can be reduced according to the present invention 
will now be illustrated with regard to Figures 10-12. hi Figure 10, display circuits 
208A, 208B are both located under pixel 204A and pixel 204B. An address line is 

1 0 provided for each display circuit, shown in the figure as address Unes 208 A, 208B. 

Meanwhile, a single pair of data lines (BIT 210A and BIT BAR 210B) are used for both 
display circuits. As a result, only 4 data and address lines are employed. By contrast to 
Figure 10, one could use a single address line for both display circuits and two data 
lines for each display circuit (not shown). This, however, would result in 5 data and 

1 5 address lines being used. 

Figure 1 1 illustrates another embodiment where there are two rows and four 
columns of pixels (300A, 300B, 300C, 300D and 302A, 302B, 302C, 302D). Each row 
of pixels is divided into two pairs with a pair of display circuits (304A-H) being 

20 positioned underneath the pair of pixels, as in Figure 1 0. Two address lines (306A-D) 
are positioned under each row of pixels and a pair of data lines (308A-D) are provided 
for each two columns of pixels. As illustrated in Figure 1 1, a total of 8 data and address 
lines are employed. By contrast, if BIT and BIT BAR lines were used for each column 
of pixels, and an address line were used for each row of pixels, 10 data and address 

25 lines would be employed. 

Figure 12 illustrates yet another embodiment where there are five display 
circuits (402A-E) and five address lines (404A-E) running under the display circuits. 
Meanwhile, a single set of data lines (406A-B) are used for the five display circuits. 



INV1P003 




38 



As can be seen, only 7 data and address lines are used. By contrast, if one were to use 1 
address line and 5 it would be connected to 3 pairs of data lines, one pair per memory 
cell. Since there are 800 columns, there would need to be 4800 data lines. Combined, a 
total of 5400 lines are needed. 

5 

Now lets assume one lays out a display matrix consisting of 600 rows and 800 
columns of pixels as illustrated in Figure 11. Each row is connected to two address 
lines. For 600 rows there would be 1200 address lines. Meanwhile, only three pairs of 
data lines are used for every two columns. For 800 columns there would be 2400 data 
1 0 lines. Combined, a total of 3600 lines are needed. 

In another example, suppose a display matrix consists of 600 rows and 800 
columns of pixels where each display circuit includes 5 memory cells. Assume each 
display circuit is positioned within the footprint of each pixel. According to this layout 
1 5 design, there would be 600 address lines (1 address line per row) and 8000 data lines 
(800 columns x 2 lines per memory cell x 5 memory cells) for a total of 8600 lines. 

Now lets assume that one lays out a display matrix consisting of 600 rows and 
800 columns of pixels as illustrated in Figure 12. Each row is connected to five address 
20 lines so 600 rows would require 3000 address lines. Meanwhile, only five pairs of data 
lines are used for every five columns. For 800 columns there would be 1600 data lines 
(800 columns x 10 lines per 5 columns). Combined, a total of 4600 lines are needed. 
As can be seen, the reduction in the number of data hnes becomes quite significant as 
the number of memory cells per display circuit increases. 



25 



Local Decoding of Addresses 

An aspect of the present invention relates to the use of local decoding of row 
addresses in the display system to reduce the number of address lines, or "word lines," 
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in the display system. According to this layout technique, decoders are inserted at 
periodic intervals in the display matrix. These decoders are connected to surrounding 
display circuits, so that each decoder is connected to rows of the display matrix. Each 
decoder receives a word line, two sub-word lines, and an enable line. The sub-word 
5 lines supply two bits, a Most Significant Bit (MSB) and a Least Significant Bit (LSB) 
which provide an offset for selecting one of the rows connected to the decoder. This 
obviates the need to connect an address line to each of the rows connected to the 
decoder. The enable bit is used to minimize power consumption. 

10 Figure 13 is a schematic illustration of local decoding. In this example, the local 

decoder 500 is connected to four rows of display circuits 502 A, 502B, 502C, 502D in 
the display matrix. The rows of display circuits connected to the local decoder 500 are 
referred to herein as a cluster of display circuits. There are three lines entering the local 
decoder from above. Two of these are most significant bit MSB 504 and the least 

1 5 significant bit LSB 506, which decode which of the four rows connected to the decoder 
is being addressed. The third line entering the local decoder from above is an enable bit 
504, intended to save power. The data Hues serve as sub-address lines by controlling 
which display circuits are being operated by the local decoder. 

20 The two data lines MSB and LSB provide an offset for selecting one of the rows 

connected to the decoder. Each value of the (MSB,LSB) pair connotes exactly one of 
the rows entering the decoder. For instance, "00" may denote the first row 502A, "01" 
the second row 502B, "10" the third row 502C, "1 1" the fourth row 502D. 

25 The connection of the rows to the decoder, coupled with the offset provided to 

the local decoder, can be used to reduce the number of address lines connected to the 
rows of the display matrix. In particular, the number of address lines may be reduced 
by a factor equal to the number of values that can be denoted by the offset. To 
illustrate, consider Figure 13. As there are four rows connected to the decoder, each of 
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these four rows may be selected by one of the four values of the offset. Thus, to select 
one of these four rows, the display system needs only one word line connected to the 
decoder, and a pair of sub-word lines to select one of those four rows connected to the 
decoder. Thus, the number of address lines used in the display system can be reduced 
5 by a factor of four. 

In the example of Figure 13, the local decoders are placed after every 16 pixel 
columns. Thus, if there are 800 pixel columns in the display matrix, there are 800/16 = 
50 decoders per row. As there are three lines entering each decoder, i.e., the sub-word 
1 0 hnes MSB, LSB, and the enable bit, there are 50x3=1 50 additional lines entering the 

display matrix. However, if there are 600 rows, the number of address lines are reduced 
by a factor of four, to 150, resulting in 450 fewer address lines. Thus, the addition of the 
150 offset and enable Hnes is countered by a decrease in 450 address lines. 

1 5 The insertion of local decoders also confers benefits during fabrication of the 

display system, as it obviates the need to fabricate word lines in metal. The present 
embodiment eliminates the need for global word lines which span each row of display 
circuits, as global word lines are replaced with relatively short interconnects between 
decoders. The relative brevity of the interconnects allows them to be fabricated in poly- 

20 silicon rather than metal. The absence of metal word lines in the IC results in improved 
packing density, and frees space for other metal interconnects. 

Reducing the Numbers of Word and Data Lines 

25 The display circuit layout designs described above, for example with regard to 

Figures 10-12, can be combined with local decoding to produce a drastic reduction in 
the number of address and data lines entering the display matrix. As illustrated in 
regard to Figures 10-12, the number of data hnes can be significantly reducedby 
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connecting data lines to multiple data circuits. The resulting increase in address lines 
can then be diminished by replacing global word lines with local decoders. 

The synthesis of these techniques can be illustrated by example. Consider a 
5 display matrix which consists of 600 rows by 800 columns and 3 memory elements per 
pixel. A display system with exactly one data circuit within the footprint of each pixel 
has 5400 total lines including 600 address lines and 4800 data lines [800x3 BIT lines 
and 800x3 BIT BAR lines]. By designing the display circuits so that two display 
circuits overlap each pixel (as in Figure 1 1), the number of address lines is doubled to. 
10 1200, but the number of BIT and BIT BAR lines reduced to 2400, for a total of 3600 
lines. If we then apply local decoding as shown in Figure 13, the number of address 
lines is reduced by a factor of 4, reducing the number of address lines to 1200/4=300. 
Hence, by employing the layout and local decoding techniques described above, a grid 
of 600 address lines and 4800 data lines can be replaced by a grid of 300 address lines 
15 and 2400 data lines. 



Modes of Operating The Display Matrix 

Several different modes for operating a display matrix according to the present 
20 invention are possible. One mode, referred to herein as the "Power Miser Mode," 

relates to a mode where writing to the display matrix is minimized, there reducing the 
amount of energy consumed by the display matrix. Another mode of operation, referred 
to herein as the "Color Rich Mode," relates to a mode where data is written to memory 
cells forming one bit plane while memory cells of another bit plane are used to display 
25 an image in order increase the number of sub-images that can be used to form a 

composite image. By being able to increase the number of sub-images that can be used 
to form a composite image, a greater number of colors may be formed by the display 
matrix. Yet another mode of operation, referred to herein as the "Color Mixing Mode," 
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involves operating a display matrix in a Power Miser Mode and Color Rich Mode at the 
same time. 

While the Power Miser, Color Rich, and Color Mixing modes for operating a 
display matrix according to the present invention are provided below, it is noted that 
many additional modes of operating the display matrices can be employed. 

1. Power Miser Mode 

One mode of operating a display matrix according to the present invention is 
illustrated in Figure 14 in which a processor 54 interfaces directly with the display 
matrix (backplane IC) 42. This mode is referred to herein as power miser mode because 
the image is initialized and modified directly in the display matrix memory without the 
use and associated power consumption of an external frame buffer. Because the 
backplane IC is fundamentally digital in nature, component and power consumption 
costs associated with digital-to-analog converters or other analog circuitry is avoided. 

hi operation, the backplane IC offers several fimctions in support of power miser 
mode. The synchronous SRAM interface on the chip coincides with the memory model 
assumedby typical processors. By using three memory cells per display circuit, the 
chip also offers capacity for a red, a green, and a blue bit plane, the minimum necessary 
for a display matrix to operate in an FSC mode. The chip can also be programmed for 
FSC control, a sequence such as the following: 

1 . Turn off all illumination and select the red data plane with the RED 
STROBE. 

2. After pausing for LCD alignment, turn on the red LED. 
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3. Turn off the red LED and select the green data plane with the GREEN 
STROBE. 

4. After pausing for LCD alignment, turn on the green LED. 

5. Turn off the green LED and select the blue data plane with the BLUE 
STROBE. 

6. After pausing for LCD ahgnment, turn on the blue LED. 

In an eight-level grayscale monochrome implementation of power miser mode, 
the RED, GREEN, and BLUE cells of each display circuit are filled with the MSB, 
SSB, and the LSB of the corresponding image data. The three bit planes can be strobed 
in a variety of time modulation schemes to achieve the eight levels of grayscale in the 
color of the single illumination source. One possibility is to strobe the bit planes in 
RMS fashion using distributed binary coding as described later. 

An additional fimction unique to power miser mode is on-chip support for 
scrolling. Scrolling in the present invention consists of shifting a scroll region 
horizontally or vertically by a pixel. The contents of a scroll buffer are used to fill in 
the area vacated by the shift. The scroll region can be an entire bit plane or portion 

thereof. 

Figure 15A illustrates an address map including scroll buffers. The address bus 
illustrated in the figure is 20 bits wide. Bits A, through Ao specify the column address 
of a byte, A,6 through A, its row address, and A.s through An its bit plane address. 
This address scheme assumes the three SRAM cells in each display element have been 
configured for separate address (WORD) signals. The address space of the display 
matrix encompasses 0-99 in the column address, 0-599 in the row address, and 0-2 in 
the bit plane address. Bit A,9 is the programming bit. 
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Buffers ou^ide the aCve region are allocated for scrolling. The address space 
of a horizontal scroll buffer encompasses 100 in the column address and 0-599 m the 
row address. There axe three horizontal scroll buffers, each differentiated by ,ts b,t 
plane address. The address space of a vertical scroll buffer encompasses 0-99 ,n the 
column address and 600-607 in the row address. There are three vertical scroll buffers, 
each differentiated by its bit plane address. 

A scroll procedure may comprise the following steps; 

1 . The scroll buffer for a particular direction and bit plane is modified through 

processor reads and writes to its address space. 

2. The scroll region programming registers are modified as necessary. The 

scroll command is issued by writing to the appropriate register. The 
backplane IC begins scrolling. 

3. When scrolling is complete, the readyNm is asserted back to the system so 
that another processor access can commence. 

TTre scroll region is the area over which data will be shifted. The scroll region is 
defined by the coordmates of its upper left (X„„ Y uO and lower right (Xu. Y 
comers The coordinates in the present invention are specified with byte ^anulartty. so 
that the possible values are 0-99 in the X-dir^tion and 0-74 in the Y-directron. Values 
greater than 99 in the X-d,rection and 74 in the Y-d,rection are prohibited. Data outstde 
the scroll region will not be affected by the scrolling operation. 

A second embodimem of scrolling is illustrated in Figure 15B. A scroll region 
is firs, defined. In Figure 15B U,e region is eight pixels high by ei^t pixels w,de. 
However, it can be any region within the display matrix on a one-pixel boundary m the 
vertical direction and a two pixel-boundary in the horizontal dtrectton. 
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soronins operation can move <he conten. of .he scroU region up or dow^^ 
• , or left or ris*. by two pixels without affecting any of the data outsrde of th. 
::r: ^ ^e.„n, one row Of Pixels ,s always left .ch.^ 

verti al scrolling and two columns of pixels hy horizontal scrolhng 
5 lhangedp,xelsn.ustheoverwnttenhythenewinfomrationfto..heextemalsyste™ 

to complete the scroll. 

scrolling is an exantple of hardware assistance for a ^'V^^^^ °^'-^°' 
o„tsidetheoperat,o„ofd,splayn,atHcesofpriorart.Bysuhsun,i„gtheex^.^^^ 

,0 buffer wiftin the display matrix of the presem invention m power nnser mode wtde 
Z^y of hardware assistance functions for image modification become posstble and 
useful within the display matrix. 



15 



20 



2. Color Rich Mode 

A second mode of operating a display matrix according to the present invention 
.illustrated .nFigurel6.in Which an exte^alftamebuffer 56 isplacedb^^^^^^^ 

processor 54 and the display matrix (bacM- IC) 42. llus mode ts referred to h.em 
Icolornchmodchecausethemultiplebitplanesinthe display matnxareused^ 

generate multiple levels of grayscale in each of the color fields. 
Lebitplanesareused, eight .evelsofgrayscale(2Veproduced«eachof.hree 

color fields for a total of 5 12 colors (8=) in FSC operation. 



An exemplary sequence 
25 follows: 



for performing color rich mode in FSC operation is as 



1 Turn off all illumination. 

2 Transfer the MSB, 2^ SB. and LSB bit planes of the red image mto the 
RED, GREEN, and BLUE memory planes of the display matnx. 
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3. Strobe .he bit planes in RMS fashion using distributed Unary coding as 
described below. 

4. Turn on the RED LED. 

5. Strobe the bit planes again in the same way. 
6 Turn offthe RED LED. 

1. Transfer the MSB, 2^ SB, and LSB bit planes of the green image mto the 

BLUE, GREEN, and RED planes of the display matrix. 
8. Strobe the bit planes. 
9.. Turn on the GREEN LED. 
10. Strobe the bit planes. 
11 Turn offthe GREEN LED. 

12. Transfer the MSB, 2^ SB, and LSB bit planes of the blue image mto the 
RED, GREEN, and BLUE planes of the display matrix. 

13. Strobe the bit planes. 

14. Turn on the BLLTE LED. 

15. Strobe the bit planes. 

Figure 17 illustrates part of the above sequence. The numbers 0, 1. and 2 are 
used to represent the RED, GREEN, and BLUE bit planes, respectively. Each cotor 
Li„thef,.urehashee„a,videdintoaRECOVERVandanACTrVEp«,o.The 

.ength of the ACTIVE period equals the length of time that the LEDs are turned on. 
detLont.nedinthertgurethoughon,inedin.heabovesequenceisth.the^™^^^ 

«me for an LED may be delayed f.om the start of the ACTIVE penod. The ACTIVE 
and RECOVERY periods may have dilferent length. Tire sum of thetr lengths ,s 
,ete,mmedbythelengthofafield.which,styp,cal,yone.tWrdthe,e„gtho^the^^^^ 

The strobing of the hi. planes both before and after an LED is mmed on ,n *e 
sequence corresponds .0 s.robing in ttre RECOVERY and ACTIVE penods m *e 
fi^re I. has been found .hrough experiment, .ha. during .he RECOVERY per,od. 
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strobing the correct value for the color field is better than driving a constant binary 1 or 

0 on the pixel. 

Gray levels in a particular color field are produced by multiplexing sub-images 
.enrporally at a very fast rate. In the temunology of color rich mode, the sub-,mages 
correspond to bit planes and multiplexing is the same as strobing. When the time for a 
particular LCD to relax or ali^, in response to a new electric field is greater than the 
duration of a sub-image, Root Mean Squared (RMS) voltage techniques can be 
employed. 

various strobing algorithms are possible to achieve a certair, gray level. For 
insumce, in a 3 bit-plane system, a conventional coding scheme might divtde up an 
interval such as the RECOVERY or ACTIVE period, into seven equal parts, and ass.gn 
the MSB plane to the first four parts, the SSB plane to the next two parts, and the LSB 
plane to flte las. part. Then a gray level 4 would be achievedby a U 11000 sequence, a 
Shy a 11 11001 sequence, etc. 

One algorithm that has been found empirically to have a better RMS effect than 
the above conventional coding scheme for a particular LCD is called distributed bmary 
coding A better RMS effect refers to the gradation in voltages driven on the liquid 
crystal being more uniform. The strobing formula for distributed binary coding is 
{MSB SSB, MSB, LSB, MSB, SSB, MSB}. For example, 0 = {0000000}, 1 =^ 
{0001000}, 2 = {0100010}, 3 = {0101010}, 4 = {1010101}, 5 = {101 1 101},. 6 = 
{ 1 1 1 0 1 1 1 } , and 7 = { 1 1 1 1 1 11 } • In Figure 1 8, distributed binary codmg is used to 
display a grayscale 3 in the red field followed by a 6 in the green field. 

While the above formula relates to the present invention with three bit planes, 
distributed binary coding can be extended to display matrices-of any number N of bit 
planes The interval is first always divided into (2^-1) time slots. The MSB plane 
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time slot, are determined first. The MSB plane is always placed in the first t,me slot 
and every other time slot there after. The 2"' SB plane time slots is calculated next. 
The SSB plane .s placed in the first available time slot and every fourth time slot 
thereafter The 3"" SB occupies the next available tune slot and every eighth slot 
thereafter, and so on until the LSB (N*) plane is place in the middle time slot. For ^ 
ins.ance.forfourbi,planes,theformulais (MSB, 2^ SB, MSB. SB, MSB, 2 SB, 
LSB, MSB, 3"" SB, MSB, 2"' SB, MSB}. 

The ability of the display system of the present invention to perform distributed 
binary coding is a strong example of one of the advantages that the display circmt of the 
present invention provides. The grayscale level is strobed twice ta one color field, once 
in the RECOVERY period and once in the ACTIVE period, for a total of 14 time slots, 
h, a system with only one memory cell per display circuit, fourteen bit ptaes would 
have to be loaded in order to strobe during 14 different time slots. This would require a 
very high bandwid«r transfer rate and pixel refresh rate. However, by using a display 
matrix capable of storing three different bit planes, different bit planes need not be 
continuously written into a display matrix. TWs allows strobing the transition between 
strobing different bit planes to be si^ificantly reduced, thereby making it possible to 
have 14 time slots. 

According to the present invention, it is possible to alternate the assigmnent of 
MSB memory matrices for consecutive color fields. This enables the display matnx to 
further take advantage of having more than one memory cell in each display circuit. 
For instance, in the above sequence, the {RED, GREEN, BLUE) memory mamccs 
were assigned to {MSB, SSB, LSB} for the RED field, while m the ensuing GREEN 
field theassigmnentswereswi.chedto{LSB,SSB,MSB}. This algorithm is dnven by 
the nature of distributed binary coding, in which the LSB plane always falls m the 
middle time slot while the MSB plane is always at the begimung. Once the LSB plane 
for the ACTIVE period of the RED field has completed, the memory plane can be used 
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for fte first plane needed by the GREEN field, which .s the MSB plane. Hence, by 
„,„difying the assignment of the b.t planes aa MSB. SSB and LSB, etc., it is poss,ble to 
increase the number of bit planes which can be wnttcn to memory and strobed. 

Distributed binary coding and the accompanying strategies discussed above 
have been found empirically preferable for certain liquid crystal formulations. Other 
algorithms may be better suited for other display matrices and are intended to fall wrth,n 
the scope of the present invention. 

The backplane IC can include logic for performing a variety of algorithms. Such 
software control can also accommodate timing parameter changes which may be 
necessitated by temperature conditions or other factors. 

Interrupts to the external frame buffer can also be provided to trigger the transfer 
of data to the next available memory plane. 

3. Color Mixing 

A third mode of operating a display matrix according to the present invention, 
referred to herein as color mixing, relates to the overlay of a color rich region on a 
power miser background. This mode ofoperation is illustrated in Figure 18. By 
combining color rich operation with power miser operation, a window of high 
information content can be formed without incurring the bandwidth and power 
consumption costs associated with full-screen color rich operation. The reduCon m 
bandwidth requirements improves the compatibility of tiie display matiix w.th vtdeo 
applications. An example of a color mixing procedure tita. may be employed >s as 
follows: 

. The window region configuration registers are modified as necessary. 
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. The power miser mode is specified to be either 3 color fields at 1-bit/field or 
3.bit monochrome, by writing to the appropriate configuration register as 

necessary. 

• Color rich windowing is enabled by writing to the appropriate configuration 
register. 

The window region is the area over which data will be displayed in color rich 
mode. The area around the outside of the window region operates in power miser 
mode. The window region is defined by the coordinates of its upper left (Xul, Y ul) 
and lower right (X.^, Y lr) comers. The coordinates must be specified with byte 
granularity, so that the possible values are 0 - 99 in the X-direction and 0 - 74 in the Y- 
direction. Values greater than 99 in the X-direction and 74 in the Y-direction are 
prohibited. 

The foregoing description of preferred embodiments of the present invention has 
been provided for the purposes of illustration and description. It is not intended to be 
exhaustive or to limit the invention to the precise forms disclosed. Obviously, many 
modifications and variations will be apparent to practitioners skilled in this art. The 
embodiments were chosen and described in order to best explain the principles of the 
invention and its practical appUcation, thereby enabling others skilled in the art to 
understand the invention for various embodiments and with various modifications as are 
suited to the particular use contemplated. It is intended that the scope of the invention 
be defined by the following claims and their equivalents. 



Additional Digital Color Methods 

The present invention also relates to-the incorporation of various algorithms into 
memory resources and their utilization in display systems to control data flow and 



INV1P003 



-51 - 



operation of a display system. Figure 19 shows a block diagram of a display system 
that may be used in the present invention. It should be noted that other configurations 
of displays, including those set forth above, may be used in practicing various 
embodiments of the present invention. 

5 

ASIC 802 is designed to take standard, bit-mapped data from the host system, 
either directly from the microprocessor 804 or by an interface circuit (not shown), and 
separate this data into separate color components (e.g., red, blue and green). These 
components are stored as separate color sub-images so that they may be supplied to the 
1 0 backplane 806 to generate each red, blue and green image (color fields) needed for 
sequential color definition. 

Given the compact size of a microdisplay, it may not be feasible to build 
sufficient memory into the backplane 806 to support displaying images with a large 
1 5 number of colors. As a resuU, an external memory is used, such as a frame buffer 808, 
in conjunction with a custom integrated circuit (ASIC) to rapidly provide this 
information to the backplane 806. Color information is supplied in a format well suited 
for the different algorithm of the present invention to be used. The hardware and 
software work together in combination with the algorithms of the present invention. 

20 

In separating and storing color data, various types of image processing, such as 
spatial dithering, may be applied to the data either before or after the image data is 
separated into the color fields. This storage can either take place within the ASIC chip 
802 or on a separate frame buffer chip 808 (memory) connected to the ASIC. 

25 

A second feature of the ASIC 802 is its abihty to rapidly send each color field to 
the backplane 806 in a specific sequence as may be required for a given algorithm. As 
is described herein, the algorithms of the present invention involve different 
appHcations of individual bits of color field data, depending on the method. These 
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various methods have been optimized for color generation under various device designs, 
environmental conditions and color requirements, and refresh rates. Data transfer bit 
sequencing, timing and clock speeds can be set by the ASIC chip. 

Since backfield chip operating voltages can be limited, this architecture allows 
for voltages supplied to the counter electrode 810 to be offset so that only the change in 
voltage required for liquid crystal transitions need be applied. The counter electrode 
offset voltage must be supplied for both positive and negative Uquid crystal voltages, as 
needed to possible negative effects caused by steady state (DC) voltage components. 
The counter-electrode 810 signals originate on the backplane chip 806 and the voltage 
levels are set by an additional driver chip (not shown in Figure 19). The ASIC chip 802 
can work with the backplane 806 to determine when and how the counter-electrode 
voltage is altered, as will be discussed in the description of the drive methods. 

A black and white image may be presented on a field sequential color display by 
presenting the same image bit pattern during Red, Green, and Blue sequential 
illumination. Pixels optically off will appear black, while those optically on will appear 
white. The image data requires only 1 bit per pixel and this data may be sent to the 
backplane once for all three color fields. 

The addition of a programmable 2x3 bit lookup table in the ASIC 802 provides a 
means of mapping colors to substitute for black and white image information, i.e. 
yellow text on a blue background. The table contains one bit for each primary color 
(RGB) to substitute for "black" bits, and one bit for each primary color to substitute for 
"white" bits, in the monochrome image data. The backplane then stores the substituted 
3 bit color for each bit written to it. The amount of data written to the backplane is still 
one bit per pixel, but the backplane can now present three substituted values, one for 
each of the color fields. 
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The 2x3 bit lookup table need not be restricted to use as color substimtion in 
monochrome images. For higher color applications, this same table can be us^ as a 
means of generating a unique LC drive method. 

1 . Balanced Binary Color Method 

A method is provided for suppressing image brightness flicker. This method is 
referred to herein as the Balanced Binary Color (BBC) method. This method may be 
used with high color applications where there is a need to suppress image bn^mess 
flicker The method can be used for color images or monochrome images by simply 
choosing the correct color field sequence. For example, normal color can be obtained 
by using the meftod to apply different color suHmages for red, green and blue color 
fields THe same data for each color field can be used for monochrome images of a, 
blackand white nature. Single color images will require only one color field. Other 
,5 combinations are possible. Furthermore, the core of this method is the way a single bit 
of color is generated. At this bit level, the method can be applied to other color 
schemes. 

According to the BBC method, each bit is used to generate a voltage across the 
20 liquid crystal, and then illuminate the resulting fiill color field by an LED flash supplied 
,0 the full backplane chip image area. The du^tion of the LED pulse provides a binary 
decoding. For example, the first pulse may be of 1 umt duration and represent the least 
si^ificant bit of color informafion. Tlie next bit is then applied and the LED is flashed 
for 2 units of duration representing the next most significant bit. This is followed by a 
25 bit of data and an LED flash 4 units in duration, and so on. 

The BBC method can be used to reduce viewing artifacts, such as flicker and 
contrast reduction, due to residual ionic contamination of the liquid crystal matenal. 
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The method will now be described in greater detail. Since the different color 
fields used in a multi-color image are defined sequentially and similarly, it is sufficient 
to describe color generation for only one color field - that is, for one complete sub- 

image of all one color. 

Color depths can range from one to eight or more bits of color per color field. 
This corresponds to from 2 to 256 shades of color for the color field. Consider the 
example of 4 bits, or 16 shades of color when decoded using binary counting. For a 
fiiUy digital backplane design, such as the one described in Application Serial No. 
09/31 1,804 (which is incorporated herein by reference in its entirety), only one bit at a 
time can be applied to the pixel electrode. 



One aspect of the invention relates to how each bit is applied at the pixel 
electrode and counter electrode prior to and during the LED flash. According to the 
1 5 BBC method, each bit used to generate color is appUed in a mamier that uses either zero 
applied voltage or equal plus and minus voltage pulses such that no net DC voltage 
component is applied. 

Previous methods employing an analog backplane have not been able to do this, 
20 usually due to the need to apply an analog voltage at each pixel. An analog voltage is 
not easily inverted and typically is inverted only on the subsequent frame (consisting of 
the fiiU 3 color fields). Digital methods have successfiiUy applied inverted pulses at the 
bit level by means of alternating control voltages over the entire image area. 

25 By contrast to these previous methods, local memory storage bits are used to 

alternate between the desired plus and minus voltages in the present invention. This is 
combined with a period of zero applied voltage at all pixels. The resulting waveform 
provides an extremely fast response with virtually total immunity to flicker due to 
device artifacts such as ionic contamination. 
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The previously discussed 2x3 bit lookup table is employed during the loading of 
image bit-plane data. Assuming that "0" represents a pixel state of 0 volts, and "1" 
represents positive voltage, the table is programmed as set forth in Table 1 : 

Table 1 

Input Bit Subrn Subr21 Sub [31 

0 0 10 

1 10 0 



The first two values, Sub[ 1 ] and Sub[2] could also be viewed as "data" and "not data". 
Note that the Sub[3] bit is the same regardless of input data. This data, when switched to 
the backplane pixels causes all pixels to go to zero volts. Because the Sub[3] bit plane is 
always written with O's, new image data can be written (changing Sub[l] and Sub[2]) while 
1 5 the Sub[3] bit plane is switched to the pixel array without affecting the LC. 

Figure 20 illustrates single color bit dynamics. As shown in Figure 20, afthe 
beginning of each bit of color, all pixels in the image array are switched to zero volts on 
the pixel electrode. The command for this action (select Sub[3] bit plane) originates in 

20 the ASIC chip 802 and is carried out by the backplane 806, but may also be carried out 
entirely by the backplane 806 if circuit densities permit sufficient control and storage on 
the backplane 806 so as to negate the need for a separate ASIC chip 802. During this 
period of zero applied voltage, the liquid crystal molecules are strongly switched into 
their normal state by the anchoring forces supplied by the alignment layers located at 

25 the pixel electrode and the counter electrode. The normal state may result in either a 
normally bright or a normally dark state in the fiiU display system, depending on the 
light path, polarizers employed and the type of electro-optic liquid crystal mode. The 
BBC method works effectively in either case. During this zero voltage phase the most 
rapid possible return to the normal state is realized since any applied voltage during this 
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period would only serve to slow the return of all pixels due to counter acting forces 
tending to orient the molecules away from this state. This zero voltage phase lasts for a 
time long enough to allow the liquid crystal molecules to mostly relax to the normal 
state and may be on the order of a millisecond in duration. 

During the zero voltage phase, two bits of data (Sub[l] and Sub[2]) are supplied 
to the local storage at each pixel location. These data bits are complimentary and 
represent a 01 or a 10 pair. For purpose of example, suppose that we associate a 01 pair 
with a dark pixel and a 10 pair with a bright pixel. Let us further suppose that the 
normal state is bright. Then zero 01 pair, for example, can be associated with a Vdd 
pixel voltage followed by a zero pixel electrode voltage. During this time, the counter 
electrode will first be set at -Vb (during the pixel "0") and then at Vdd+Vb (during the 
pixel "1"). The result will be a high voltage of magnitude Vdd+Vb applied during the 
full data phase. If we measure the applied voUage across the liquid crystal at the pixel 
electrode with the counter electrode as a reference, then the voltage would follow the 
dark line 2002 in Figure 20, first reaching a value of Vdd+Vb and then an equal and 
negative voltage of-Vdd-Vb. The liquid crystal molecular orientation responds only to 
the magnitude of this voltage and so it is acted on by a uniform orienting force during 
the data phase. In this example, the result would be a dark bit value for this particular 
pixel. 

Other pixels, if they were loaded with a 10 pair would have first zero pixel 
electrode voltage, then Vdd pixel electrode voltage applied. The counter electrode, 
since it is common to the entire pixel array, would again see -Vb (during the "1") 
followed by Vdd+Vb (during the "0"). This would produce a net voltage of magnitude 
Vb across the liquid crystal material. If Vb is chosen low enough to maintain the liquid 
crystal in the normal state, a bright bit value for this pixel would result. The voltage 
measured across the liquid crystal in this case is shown by the heavy dashed line. 
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The result is a balance of the applied voltage, and the resulting electric field, at 
each pixel and for each individual bit comprising the color image. This allows 
extremely little time for ion migration to occur and affect the desired performance. 
Since these effects can occur on timescales associated with a single polarity of applied 
voltage, this method can reduce such timescales to the sub-millisecond range. Contrast 
this to the analog method where a single polarity of applied voltage is applied during 
each color field. The polarity is not reversed until the next fiiU color fi-ame. Thus a 60 
frame per second analog display would see a balanced voltage pulse applied at a rate of 
only 30 times per second since 2 frames are necessary. Thus the BBC method balances 
the appUed voltages over timescales up to 50 times faster or more. In fact, extremely 
high speed operation, with multiple alternating drive voltage swings during each bit, 
could be achieved in situations where the electronics can support this operation. 

Another important effect of the BBC method is that it can be very fast. 
Relaxation to the normal state occurs as fast as possible under zero voltage conditions. 
And alignment to the driven state occurs under a fiiU voltage pulse, not the partial 
voltage typical of analog schemes. 

It should be noted that this method is not limited to the specific assignments 
used in the example. The 01 or 10 pairs can be associated with pixel voltages 
differently, along with the counter electrode voltage, as long as the result is a magnitude 
Vdd+Vb net liquid crystal voltage for driven states and a magnitude of Vb for normal 
states during the data phase. Normal states can be either bright or dark and driven states 
can likewise be chosen to be the corresponding opposite to any normal state. 

Figure 21 illustrates how the BBC method is used to produce a single RGB (red, 
green, blue) color frame. The top curve 2102 shows the vohage at the liquid crystal. 
The middle curve 2104 shows the liquid crystals response to this voltage. The bottom 
curve 2106 shows the LED flash sequence with binary weighted flash duration. A 



INV1P003 



-58- 



single full frame of red, green and blue is shown for the case were 3 bits of data are 
applied for each of the red, green and blue colors. This would produce 512 colors total, 
after the eye and brain of the viewer fiises the temporally separate color images. The 
number of bits in the example is arbitrary. Total time for each color field is 
5 approximately: 

N[(rise time) + (fall time)] 
where N is the number of bits being displayed per color 

10 

Accordingly, an image generation system is provided. A display matrix is 
provided and has a plurality of display elements which can include liquid crystal. Each 
display element includes a pixel. A plurality of display circuits are electrically 
connected to a display element. A plurality of memory cells are associated with each of 
15 the circuits, or form part of the circuit, and a selector continuously electrically 

connected to more than one of the plurality of memory cells, the selector outputting to 
the pixel data from one memory cell at a time. Peripheral control circuits preferably 
control read and write operations to the memory cells. 

20 According to this embodiment, the virtual image display system further includes 

a Ught emitting mechanism, which may be a mechanism provided at each pixel, a light 
modulating mechanism provided at each pixel, and/or an illumination source for 
illuminating the pixels. Logic suppresses image flicker utihzing balanced binary color. 
The same data can be used to display monochrome and color information. 

25 

According to the present invention, each memory cell is divided into a bit that is 
used to generate a voltage across the liquid crystal and illuminate a color field using an 
LED pulse. Preferably, the duration of the LED pulse provides a binary decoding. 
Alternatively or in addition to providing the binary decoding, the pulse can have a set 
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duration and represent a bit of color information, n pulses of n duration may be applied 
where each pulse represents the n most significant bit of color information. 

The system reduces viewing artifacts due to residual ionic contamination of the 
display material. A balance of an applied voltage and a resulting electric field form a 
color image rapidly which diminishes the time for ion migration and enhances the color 
image quality. A polarity reversal to a voltage applied to a liquid crystal is decoupled 
from a display update frequency. 

Figure 22 is a flow diagram of a process 2200 for generating an image, hi 
operation 2202, a display element of a display is switched to zero volts for a first 
duration of time, where the display element includes a pixel. A first voltage is suppUed 
to an electrode of the display element for a second amount of time in operation 2204. In 
operation 2206, a second voltage is suppUed to a counterelectrode of the display 
element for a third period of time such that no net voltage (i.e., V, + V2 = 0) is appUed 
to the display element across the sum of the time periods. The second voltage may be 
of a substantially equal magnitude and can be suppUed to the counterelectrode for about 
the same time as the aforementioned predetermined time. An illumination pulse is 
applied to the pixel in operation 2208 for illuminating the display element for a 
predetermined number of units of duration where the units of duration can be in 
fractions of milliseconds, etc. This process can be repeated for each bit of color 
information to be displayed. 

2. DIGITALLY CONTROLLED WAVEFORM METHOD 

Another method according to the present invention is the Digitally Controlled 
Waveform (DCW) method. This method may be used independently of the BBC 
method or in conjunction with it. 
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According to the present invention, the DCW method can be performed by 
controlling individual bit responses using the techniques of the BBC method and a 
simple binary digital application of the data. 

5 The DCW method is desirable when response speed is important, such as at 

lower temperatures. By contrast, the full BBC method is more desirable when it is 
needed to reduce flicker. 



The DCW method's response time advantage is made possible by only requiring 
10 a single rise and fall time for each color field, rather than one per color bit as needed in 
standard binary methods. The relaxation time (rise time for a display that is normally 
white) may or may not occur at zero volts in this method, and so the relaxation time 
could be somewhat longer. Nevertheless, the method still has a strong overall 
advantage in terms of response time due to the single waveform approach. The basic 
15 shape of the waveform 2300 is shown in Figure 23. 

According to the method, 4 bits of data are used to display a 3 bit color image 
field for every pixel. The wavefomi consists of a single rise and fall waveform 
incorporating fi-om zero to 4 LED flashes depending on the value of the 4 data bits. 

20 This scheme is able to fully display the shades of color produced by 3 data bits at the 
fi-ame buffer. The 3 data bits produce 8 levels of color for the red, blue or green color 
fields. These 8 levels correspond to values of 0 to 7 in intensity. These 8 levels can be 
represented by various combinations of LED flashes of weight 1, 2, 2, and 2. The 4 bits 
supplied by the ASIC to the backplane map the original 3 bits into the new 4 bit space 

25 with only a single rise and fall. Table 2, below, shows an example of the mapping: 



Table 2 

Original 3 Bits Value 4 Bit Sequence ( 1 +2+2+2) 

000 0 0000 

30 001 1 1000 



INV1P003 



-61 - 



010 2 0001 

011 3 1100 

100 4 0011 

101 5 1110 

110 6 0111 

111 7 nil 



As can be seen from Table 2, the waveform has only a single rise and fall. 

It is noted that the exact shape of the waveform only indirectly controls the 
intensity value. This is due to the use of the waveform as an envelope to include the 
appropriate LED pulses of duration 1 and 2 units. To the degree that the waveform 
approaches a square wave, the coupling can be very weak. For fmite rise and fall times, 
some interaction between the LED flashes and the waveform shape occurs. Because of 
this, the first LED flash of unit duration maybe made slighfly longer to compensate. 
Other adjustments can be made to achieve the most faithful representation of the 
original 8 levels. For a full color frame of data, similar sequences are strung together 
for red, green and blue color fields. Note that no special voltage pulses are required. 
Also, this technique relies on the use of local data storage for each pixel. The write 
times for these pixels can be invisible as long as the data transfer rate from the ASIC 
and frame buffer is faster for each bit than either rise or a fall, but not the sum of rise 
and fall. This is due to the need only to begin or end the single waveform before or 
after an LED pulse. 

The total duration of a color field is may be expressed by: 
(rise time) + (fall time) + 3(max time) 
where'max time is the maximum of rise time or fall time 
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A variation on the above scheme maps 3 bits (8 levels) into a total of 5 bits on 
the backplane. With this method the total field time can be reduced to: 

(rise time) + 4(fall time) 

5 

where rise time > fall time. 

To make this work, one must compensate for the fact that insufficient time is 
allowed for the initial waveform rise for values of 2, 4, and 6 color shade. Therefore, a 
1 0 fifth compensation bit is provided and turned on for these values. The modified table 
below shows the mapping: . 



15 



20 



Original 3 Bits 

000 
001 
010 
Oil 
100 
101 
110 
111 



Table 3 

Value 5 Bit Sequence 

(1+2+2+2+ compensation) 

0 00000 

1 10000 

2 00011 

3 11000 

4 00111 

5 11100 

6 01111 

7 11110 



25 



30 



The waveforms of Figure 23 include this compensation bit. For cases where the 
falltime is much less than the risetime, this method can be considerably faster. Consider 
the case of 0.5 millisecond falltime and 1.0 millisecond risetime. Then the compensated 
DCW method requires 3 milliseconds per color field and frame rates approximately as 
high as 1 1 1 fi-ames/second can be achieved. Alternately, lower temperature operation 
can be provided at 60 fi^ames/second. Compare this to 3 bits per color with standard 
binary methods where 3(1.5milliseconds) are needed per field, resulting in a maximum 
fi-ame rate of 74 fi-ames/second. 
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Figure 24 is a flowchart of a process 2400 for generating an image. In operation 
2402, a shade of color is generated by controlling a duration that each display element is 
optically on. Illumination is applied to illuminate the display element in operation 
5 2404. 



In a preferred embodiment, an additional data bit is used to display a color 
image field for each pixel. According to an embodiment, n flashes corresponding to the 
value of the data in the memory cell are used to vary the intensity of the image display. 
_ 10 A single rise and fall time can be used for a color field to enhance image processing, 
5 and this does not have to be dependent upon the number of bits employed. Preferably, 

the width of a pulse defines a grayscale of a color. Thus, the width of a voltage pulse 
can be used a grayscale of color. Alternatively, one or more illumination pulses can be 
f applied to the display element for illuminating the display element for generating a 

^ 1 5 shade of color, one pulse for each data bit in a sequence of data bits of a color field. 



3. Analog Controlled Waveform Method 

In Active-Matrix panels, RGB levels are stored into the array as analog voltage 
20 levels. These levels control directly the voltage applied to liquid crystal between pixel 
and ITO layer to produce the various shades of color under constant illumination. The 
voltage level of each pixel is mamtained by the active-matrix circuit until a new value is 
applied to the pixel. 

25 Red, green, and blue component sub-pixels are simultaneously applied to the LC 

as a group to form a single pixel. Variations in color response of the LC is accounted 
for in each pixel, rather than by different voltage levels of ITO. 
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Binary control of LC avoids many complications of analog drive methods. 
Analog control is far more sensitive to variations in cell gap, temperature, and LC 
contaminates, requiring high levels of quality control during manufacture. 



5 However, binary methods have inherently been more limited in terms of color 

depth due to optical response time of ordinary LC. This limitation can be substantially 
overcome by application of a variation of the DCW drive method as set forth in the 
section above entitled "Digitally Controlled Waveform Method." 

10 Rather than following the prior art method of applying the analog voltage to 

drive the Liquid Cystal (LC) to various points on the EO curve to produce shades of 
color, the voltage (at each pixel) is compared to a reference voltage input to the LC to 
control the duration that the LC is "optically on", such as in a similar manner as set 
forth above in the section entitled "Digitally Controlled Waveform Method.'* For each 

15 frame (or field when using field sequential color), all pixels in the matrix are allowed to 
become optically on (or off) prior to the application of illumination. When illumination 
is applied, the reference voltage is changed over time, causing each pixel to change state 
(optically on to off, or off to on) at the precise time that its voltage value matches the 
reference level. It should be noted that the matching value may instead be a threshold 

20 differential value for the transistor used as the analog computer. 

Figure 25A is a diagram of a circuit 2500 associated with one pixel according to 
an embodiment of the present invention. As shown, a multiplexer 2501 receives a 
reference input signal (that represents the reference voltage) and a data input (that will 
25 be stored in the capacitor as set forth below). A Digital to Analog (D/A) converter 2502 
converts the digital data input signal from the multiplexer to an analog pixel voltage that 
that is stored in a capacitor 2504. This is the voltage that will be compared to the 
reference voltage. 
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The D/A converter generates an analog reference voltage from a digital 
reference input signal. A comparator 2506 compares the reference voltage to the stored 
pixel voltage. Upon the reference voltage crossing over the pixel voUage, the 
comparator indicates such event, such as by switching from high to low, for example. 
A select switch 2508 is used to send the input reference voltage to the comparator. 

A pixel latch 2510 receives input from the comparator. If the comparator input 
indicates that there was a match, the pixel latch will switch to turn the pixel to the 
opposite state. If the comparator input indicates that there was not a match, the pixel 
latch will remain unchanged, as will the pixel state. A level shifter 2512 changes the 
voltage to a higher voltage, such as where the output voltage to the pixel electrode is 
higher than the operating voltage for other portions of the circuit, for example. The 
higher or lower voltage from the level shifter is sent to a pixel electrode 2514 to change 
the state of the pixel. 

For field sequential color, the analog levels of RGB can be individually selected 
{multiplexed) over time for presentation to the analog comparator. The output of the 
comparator controls the state of a single pixel, which is illuminated with the appropriate 
color in the field sequence. 

Since the output of such an arrangement is essentially digital, local pixel 
inversion can be applied in concert with ITO inversion to allow for the benefits of AC 
driving of the LC. 

The described circuit and method can be applied as an improvement to all 
existing implementations of analog active matrix LC panels and cells. The described 
circuit may be equally applicable as an improvement to non-active matrix 
implementations of analog LC panels and cells as well as to MEMS displays and other 
types of displays. 
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The described circuit may have direct application to control color levels in 
OLED displays. In this case, OLEDs may be driven digitally in their optimum 
illumination range, resulting in potential power savings and simplified color level 
5 control. Additionally, by separating pixel groups into multiple phased cycles, power 
consumption can be spread evenly over time. These grouped pixels may, of course, be 
physically interspersed on the display to avoid flicker a low update rates. 

Figure 25B is a flow diagram of a process 2550 for driving a display, hi 
10 operation 2552, a voltage value is stored in an analog memory associated with each 
pixel of a display, where each of the pixels also has a comparator associated with it. 
Note that there may be single memory cells for each pixel. A reference voltage and the 
voltage values stored in the analog memory are applied to the comparators of the pixels 
in operation 2554. In operation 2556, the comparators are used to compare the voltage 
1 5 values with the reference voltage for determining which of the voltage values matches 
the reference voltage. The state of the pixels whose voltage values match the reference 
voltage is changed in operation 2558. 

Again, the display can be an active matrix panel display as well as a non-active 
20 matrix display, OLED display, or other type of display. As an option, illumination may 
be appUed after the actuation of the one or more pixels. The reference voltage can be 
changed as a function of time to cause each pixel to actuate and de-actuate at a desired 
time. Groups of the pixels can be actuated. In such case, the groups of pixels are 
actuated in multiple phased cycles. Preferably, the groups are interspersed on the 
25 display to avoid flicker at low update rates. 

The human eye does not perceive light intensity in a linear fashion. If a light 
source is emitting twice the number of photons as another, it appears brighter to the 
human eye, but is not perceived as "twice as bright". Human perception of light 
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intensity follows a logarithmic curve. Therefore, to faithfully reproduce an image, 
gamma correction may be required. 

Because each pixel can be made to change state after a particular period of time 
has elapsed, the gamma of each pixel can be precisely controlled. By changing the 
waveform for a particular pixel (to change the period of time that the pixel is on or off), 
the level of gray can be adjusted for each pixel to provide gamma correction. 

4. SuperFrame Dithering Method 



Another method, referred to herein as the SuperFrame Dithering (SFD) method, 
is provided for displaying additional bits of color without the need for increasing the 
number of digital bits per color field during each fi-ame. For example, the method 
enables N+M bits of color to be displayed using N digital bits per color field where M is 
15 1,2, 3 or more. 

According to the method, N+M bits of color are applied to N digital bits per 
color field over several frames where the M bits of additional color are applied in a 
spatially distributed manner so as to reduce the amount of brightness modulation that is 
20 observed. 

The SFD method may or may not be used with the BBC method. In order to 
understand how the SFD method adds a bit per color (N+1) to a N bit/color drive 
method, imagine that four bits of color data are stored in the frame buffer. To display 
25 the fourth bit using a 3 digital bits, the value of the fourth bit of data may be added to 
every other frame where the third bit of the data would appear. Table 4 below 
illustrates the case for the example where the three most significant bits are 010 for both 
a 0 and a 1 fourth bit value over sequential frames. 
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Table 4 





Data = 0100 


Data = 0101 


Frame 


Pixel Values 


Pixel Values 


A 


010 


010 


B 


010 


Oil 


A 


010 


010 


B 


010 


Oil 


A 


010 


010 


B 


010 


Oil 



10 

When one averages what is observed over time, the perceived pixel values for 
three bits as shown above correspond to the four bit pixel values. In other words 010 
and 01 1 average to the binary value 0101 as long as we apply the most significant bits 
with the same weighting for 3 or 4 bit numbers. Physically, the same effect on average 
1 5 is achieved that would be achieved by adding one more binary data cycle with a flash 
duration half as long as the original third bit's flash duration. 

One problem with the above-described method is that the intensity varies at half 
the frame rate. As a result, flicker may be perceived. For example, at a frame rate of 90 
20 frames /sec, the third and fourth bit would appear at only 45 cycles/sec. This could 

result in flicker since the viewer would observe brightness modulation at 45 cycles/sec, 
well into the range where most viewers are very sensitive to flicker. 

In order to address this problem, the SFD method fiirther includes spatially 
25 distributing when the additional bit is displayed so that the additional bit is not 

displayed by all the pixels at the same time. Since the human vision system responds 
more slowly to data with fine detail, spatially offsetting the frames where the additional 
bit is being displayed reduces the perceived flicker. 
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Figures 26 shows one method for achieving a spatial offset. As illustrated in 
Figure 26, each group of 2 pixels along a row or column contains pixels with both A 
and B frames. 

5 By not showing a given frame across an image at the same time, the intensity 

modulation is not perceived. This is easy to see for the case of a region of uniform 
color. The viewers averages over time and so the full resolution of the image is 
realized. The possible artifact of flicker is minimized due to the averaging over 
adjacent pixels. This allows the use of temporal dither at color depths that would 

10 otherwise not be possible due to the perceivable amount of intensity fluctuation at half 
the frame rate. 

Two bits of temporal color can also be added. The pixel values are shown in 
Table 5: 

15 

Table 5 







Data=01000 


Data=0l001 


Data=01010 


Data-01011 




Frame 


Pixel Values 


Pixel Values 


Pixel Values 


Pixel Values 




A 


010 


010 


010 


Oil 


20 


B 


010 


Oil 


Oil 


Oil 




C 


010 


010 


010 


010 




D 


010 


010 


Oil 


Oil 




A 


010 


010 


010 


Oil 




B 


010 


Oil 


Oil 


Oil 


25 


C 


010 


010 


010 


010 




D 


010 


010 


Oil 


Oil 



The values shown above for the sequence of four different frames is not unique 
but is shown for illustration. Figure 27 shows a method of spatially staggering these 
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values under the assumption that a pixel at an "A" value becomes "B" on the next 
frame, "B" becomes "C", "C" becomes "D" and "D" becomes "A" as we cycle from 
frame to frame. This pattern in effect is a phasing of the data and the same process is 
applied to all 3 color fields in the frame. When the image is averaged over four 

5 adjacent pixels, any square or along any row or column, the correct value is realized for 
the vast majority of locations in the array at any point in time. This will be true for all 
frames as well. The correct value will also be realized for any pixel when averaged 
over 4 frames. For example, a display operating at a frame rate of 80 frames/second 
will generate the correct intensity perception if the user can average over four frames. 

10 The flicker which could be perceived as low as 20 cycles/second is suppressed by the 
spatial averaging. Various other spatial averaging schemes are possible. 

The foregoing description of preferred embodiments of the present invention has 
been provided for the purposes of illustration and description. It is not intended to be 

15 exhaustive or to limit the invention to the precise forms disclosed. Obviously, many 
modifications and variations will be apparent to practitioners skilled in this art. The 
embodiments were chosen and described in order to best explain the principles of the 
invention and its practical application, thereby enabling others skilled in the art to 
understand the invention for various embodiments and with various modifications as are 

20 suited to the particular use contemplated. It is intended that the scope of thejnvention 
be defined by the following claims and their equivalents. 
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